Jul 31 18:35:04 user nova-compute[72810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 31 18:35:06 user nova-compute[72810]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72810) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 18:35:06 user nova-compute[72810]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72810) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 18:35:06 user nova-compute[72810]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72810) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 18:35:06 user nova-compute[72810]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 31 18:35:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:35:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:35:06 user nova-compute[72810]: INFO nova.virt.driver [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 31 18:35:07 user nova-compute[72810]: INFO nova.compute.provider_config [None req-474a9633-89ca-4002-812f-86df84483f89 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Acquiring lock "singleton_lock" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Acquired lock "singleton_lock" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Releasing lock "singleton_lock" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Full set of CONF: {{(pid=72810) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ******************************************************************************** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Configuration options gathered from: {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ================================================================================ {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] allow_resize_to_same_host      = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] arq_binding_timeout            = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] backdoor_port                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] backdoor_socket                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] block_device_allocate_retries  = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] block_device_allocate_retries_interval = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cert                           = self.pem {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute_monitors               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] config_dir                     = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] config_drive_format            = iso9660 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] config_source                  = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] console_host                   = user {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] control_exchange               = nova {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cpu_allocation_ratio           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] daemon                         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] debug                          = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] default_access_ip_network_name = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] default_availability_zone      = nova {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] default_ephemeral_format       = ext4 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] default_schedule_zone          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] disk_allocation_ratio          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] enable_new_services            = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] enabled_ssl_apis               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] flat_injected                  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] force_config_drive             = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] force_raw_images               = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] graceful_shutdown_timeout      = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] heal_instance_info_cache_interval = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] host                           = user {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_build_timeout         = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_delete_interval       = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_name_template         = instance-%08x {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_usage_audit           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_usage_audit_period    = month {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] internal_service_availability_zone = internal {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] key                            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] live_migration_retry_count     = 30 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_config_append              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_dir                        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_file                       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_options                    = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_rotate_interval            = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_rotate_interval_type       = days {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] log_rotation_type              = none {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] long_rpc_timeout               = 1800 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_concurrent_builds          = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_concurrent_live_migrations = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_concurrent_snapshots       = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_local_block_devices        = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_logfile_count              = 30 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] max_logfile_size_mb            = 200 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] maximum_instance_delete_attempts = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metadata_listen                = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metadata_listen_port           = 8775 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metadata_workers               = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] migrate_max_retries            = -1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] mkisofs_cmd                    = genisoimage {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] my_ip                          = 10.0.0.210 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] network_allocate_retries       = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] osapi_compute_listen_port      = 8774 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] osapi_compute_unique_server_name_scope =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] osapi_compute_workers          = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] password_length                = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] periodic_enable                = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] periodic_fuzzy_delay           = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] pointer_model                  = ps2mouse {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] preallocate_images             = none {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] publish_errors                 = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] pybasedir                      = /opt/stack/nova {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ram_allocation_ratio           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rate_limit_burst               = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rate_limit_except_level        = CRITICAL {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rate_limit_interval            = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reboot_timeout                 = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reclaim_instance_interval      = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] record                         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reimage_timeout_per_gb         = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] report_interval                = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rescue_timeout                 = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reserved_host_cpus             = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reserved_host_disk_mb          = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reserved_host_memory_mb        = 512 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] reserved_huge_pages            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] resize_confirm_window          = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] resize_fs_using_block_device   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] resume_guests_state_on_host_boot = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rpc_response_timeout           = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] run_external_periodic_tasks    = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] running_deleted_instance_action = reap {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] running_deleted_instance_timeout = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler_instance_sync_interval = 120 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_down_time              = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] servicegroup_driver            = db {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] shelved_offload_time           = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] shelved_poll_interval          = 3600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] shutdown_timeout               = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] source_is_ipv6                 = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ssl_only                       = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] state_path                     = /opt/stack/data/nova {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] sync_power_state_interval      = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] sync_power_state_pool_size     = 1000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] syslog_log_facility            = LOG_USER {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] tempdir                        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] timeout_nbd                    = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] transport_url                  = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] update_resources_interval      = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_cow_images                 = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_eventlog                   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_journal                    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_json                       = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_rootwrap_daemon            = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_stderr                     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] use_syslog                     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vcpu_pin_set                   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plugging_is_fatal          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plugging_timeout           = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] virt_mkfs                      = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] volume_usage_poll_interval     = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] watch_log_file                 = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] web                            = /usr/share/spice-html5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_concurrency.disable_process_locking = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.auth_strategy              = keystone {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.compute_link_prefix        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.dhcp_domain                = novalocal {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.enable_instance_password   = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.glance_link_prefix         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.instance_list_per_project_cells = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.list_records_by_skipping_down_cells = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.local_metadata_per_cell    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.max_limit                  = 1000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.metadata_cache_expiration  = 15 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.neutron_default_tenant_id  = default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.use_forwarded_for          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.use_neutron_default_nets   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_dynamic_targets = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_jsonfile_path   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.backend_argument         = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.config_prefix            = cache.oslo {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.dead_timeout             = 60.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.debug_cache_backend      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.enable_retry_client      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.enable_socket_keepalive  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.enabled                  = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.expiration_time          = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.hashclient_retry_attempts = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_dead_retry      = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_password        =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_sasl_enabled    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.memcache_username        =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.proxies                  = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.retry_attempts           = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.retry_delay              = 0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.socket_keepalive_count   = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.socket_keepalive_idle    = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.socket_keepalive_interval = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.tls_allowed_ciphers      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.tls_cafile               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.tls_certfile             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.tls_enabled              = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cache.tls_keyfile              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.auth_section            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.auth_type               = password {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.cafile                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.certfile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.collect_timing          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.cross_az_attach         = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.debug                   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.endpoint_template       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.http_retries            = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.insecure                = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.keyfile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.os_region_name          = RegionOne {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.split_loggers           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cinder.timeout                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.cpu_dedicated_set      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.cpu_shared_set         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.image_type_exclude_list = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.resource_provider_association_refresh = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.shutdown_retry_interval = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] conductor.workers              = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] console.allowed_origins        = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] console.ssl_ciphers            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] console.ssl_minimum_version    = default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] consoleauth.token_ttl          = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.cafile                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.certfile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.collect_timing          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.connect_retries         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.connect_retry_delay     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.endpoint_override       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.insecure                = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.keyfile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.max_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.min_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.region_name             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.service_name            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.service_type            = accelerator {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.split_loggers           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.status_code_retries     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.timeout                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] cyborg.version                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.backend               = sqlalchemy {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.connection            = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.connection_debug      = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.connection_parameters =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.connection_recycle_time = 3600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.connection_trace      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.db_inc_retry_interval = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.db_max_retries        = 20 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.db_max_retry_interval = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.db_retry_interval     = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.max_overflow          = 50 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.max_pool_size         = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.max_retries           = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.mysql_enable_ndb      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.mysql_wsrep_sync_wait = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.pool_timeout          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.retry_interval        = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.slave_connection      = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] database.sqlite_synchronous    = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.backend           = sqlalchemy {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.connection        = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.connection_debug  = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.connection_parameters =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.connection_recycle_time = 3600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.connection_trace  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.db_inc_retry_interval = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.db_max_retries    = 20 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.db_max_retry_interval = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.db_retry_interval = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.max_overflow      = 50 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.max_pool_size     = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.max_retries       = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.mysql_enable_ndb  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.pool_timeout      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.retry_interval    = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.slave_connection  = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] api_database.sqlite_synchronous = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] devices.enabled_mdev_types     = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ephemeral_storage_encryption.enabled = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.api_servers             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.cafile                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.certfile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.collect_timing          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.connect_retries         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.connect_retry_delay     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.debug                   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.default_trusted_certificate_ids = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.enable_certificate_validation = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.enable_rbd_download     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.endpoint_override       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.insecure                = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.keyfile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.max_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.min_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.num_retries             = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.rbd_ceph_conf           =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.rbd_connect_timeout     = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.rbd_pool                =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.rbd_user                =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.region_name             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.service_name            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.service_type            = image {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.split_loggers           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.status_code_retries     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.timeout                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.verify_glance_signatures = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] glance.version                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] guestfs.debug                  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.config_drive_cdrom      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.config_drive_inject_password = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.enable_remotefx         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.instances_path_share    =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.limit_cpu_features      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.use_multipath_io        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.vswitch_name            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] mks.enabled                    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.manager_interval   = 2400 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.precache_concurrency = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.remove_unused_base_images = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] image_cache.subdirectory_name  = _base {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.api_max_retries         = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.api_retry_interval      = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.auth_section            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.auth_type               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.cafile                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.certfile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.collect_timing          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.connect_retries         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.connect_retry_delay     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.endpoint_override       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.insecure                = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.keyfile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.max_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.min_version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.partition_key           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.peer_list               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.region_name             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.serial_console_state_timeout = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.service_name            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.service_type            = baremetal {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.split_loggers           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.status_code_retries     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.timeout                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ironic.version                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] key_manager.fixed_key          = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.barbican_api_version  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.barbican_endpoint     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.barbican_endpoint_type = public {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.barbican_region_name  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.cafile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.certfile              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.collect_timing        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.insecure              = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.keyfile               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.number_of_retries     = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.retry_delay           = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.send_service_user_token = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.split_loggers         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.timeout               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.verify_ssl            = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican.verify_ssl_path       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.auth_section = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.auth_type = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.cafile   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.certfile = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.collect_timing = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.insecure = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.keyfile  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.split_loggers = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] barbican_service_user.timeout  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.approle_role_id          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.approle_secret_id        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.cafile                   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.certfile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.collect_timing           = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.insecure                 = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.keyfile                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.kv_mountpoint            = secret {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.kv_version               = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.namespace                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.root_token_id            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.split_loggers            = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.ssl_ca_crt_file          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.timeout                  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.use_ssl                  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.cafile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.certfile              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.collect_timing        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.connect_retries       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.connect_retry_delay   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.endpoint_override     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.insecure              = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.keyfile               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.max_version           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.min_version           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.region_name           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.service_name          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.service_type          = identity {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.split_loggers         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.status_code_retries   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.timeout               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] keystone.version               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.connection_uri         =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_mode               = custom {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: WARNING oslo_config.cfg [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_power_governor_high = performance {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_power_management   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.device_detach_attempts = 8 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.device_detach_timeout  = 20 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.disk_cachemodes        = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.disk_prefix            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.enabled_perf_events    = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.file_backed_memory     = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.gid_maps               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.hw_disk_discard        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.hw_machine_type        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_rbd_pool        = rbd {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_type            = default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.images_volume_group    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.inject_key             = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.inject_partition       = -2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.inject_password        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.iscsi_iface            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.iser_use_multipath     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_downtime = 500 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_inbound_addr = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_scheme  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_timeout_action = abort {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_tunnelled = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: WARNING oslo_config.cfg [None req-474a9633-89ca-4002-812f-86df84483f89 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 31 18:35:07 user nova-compute[72810]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 31 18:35:07 user nova-compute[72810]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 31 18:35:07 user nova-compute[72810]: and ``live_migration_inbound_addr`` respectively.
Jul 31 18:35:07 user nova-compute[72810]: ).  Its value may be silently ignored in the future.
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.live_migration_with_native_tls = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.max_queues             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.nfs_mount_options      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_pcie_ports         = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.pmem_namespaces        = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.quobyte_client_cfg     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rbd_secret_uuid        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rbd_user               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rescue_image_id        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rescue_kernel_id       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.rx_queue_size          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.smbfs_mount_options    =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.snapshot_compression   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.snapshot_image_format  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.sparse_logical_volumes = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.swtpm_enabled          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.swtpm_group            = tss {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.swtpm_user             = tss {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.sysinfo_serial         = unique {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.tb_cache_size          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.tx_queue_size          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.uid_maps               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.use_virtio_for_bridges = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.virt_type              = kvm {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.volume_clear           = zero {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.volume_clear_size      = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.volume_use_multipath   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_cache_path   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.auth_section           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.auth_type              = password {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.cafile                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.certfile               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.collect_timing         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.connect_retries        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.connect_retry_delay    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.default_floating_pool  = public {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.endpoint_override      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.extension_sync_interval = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.http_retries           = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.insecure               = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.keyfile                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.max_version            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.min_version            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.ovs_bridge             = br-int {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.physnets               = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.region_name            = RegionOne {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.service_metadata_proxy = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.service_name           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.service_type           = network {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.split_loggers          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.status_code_retries    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.timeout                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] neutron.version                = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] notifications.bdms_in_notifications = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] notifications.default_level    = INFO {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] notifications.notification_format = unversioned {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] notifications.notify_on_state_change = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] pci.alias                      = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] pci.device_spec                = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] pci.report_in_placement        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.auth_section         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.auth_type            = password {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.cafile               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.certfile             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.collect_timing       = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.connect_retries      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.connect_retry_delay  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.default_domain_id    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.default_domain_name  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.domain_id            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.domain_name          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.endpoint_override    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.insecure             = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.keyfile              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.max_version          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.min_version          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.password             = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.project_domain_id    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.project_domain_name  = Default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.project_id           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.project_name         = service {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.region_name          = RegionOne {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.service_name         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.service_type         = placement {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.split_loggers        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.status_code_retries  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.system_scope         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.timeout              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.trust_id             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.user_domain_id       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.user_domain_name     = Default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.user_id              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.username             = placement {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] placement.version              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.cores                    = 20 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.count_usage_from_placement = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.injected_file_content_bytes = 10240 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.injected_file_path_length = 255 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.injected_files           = 5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.instances                = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.key_pairs                = 100 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.metadata_items           = 128 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.ram                      = 51200 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.recheck_quota            = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.server_group_members     = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] quota.server_groups            = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rdp.enabled                    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.image_metadata_prefilter = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.max_attempts         = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.max_placement_results = 1000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] scheduler.workers              = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.host_subset_size = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.isolated_hosts = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.isolated_images = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.pci_in_placement = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.track_instance_changes = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metrics.required               = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metrics.weight_multiplier      = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] metrics.weight_setting         = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.enabled         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.port_range      = 10000:20000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] serial_console.serialproxy_port = 6083 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.auth_section      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.auth_type         = password {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.cafile            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.certfile          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.collect_timing    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.insecure          = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.keyfile           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.send_service_user_token = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.split_loggers     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] service_user.timeout           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.agent_enabled            = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.enabled                  = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.html5proxy_port          = 6082 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.image_compression        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.jpeg_compression         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.playback_compression     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.server_listen            = 127.0.0.1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.streaming_mode           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] spice.zlib_compression         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] upgrade_levels.baseapi         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] upgrade_levels.cert            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] upgrade_levels.compute         = auto {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] upgrade_levels.conductor       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] upgrade_levels.scheduler       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.cafile = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.certfile = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.insecure = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vendordata_dynamic_auth.timeout = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.api_retry_count         = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.ca_file                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.cache_prefix            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.cluster_name            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.connection_pool_size    = 10 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.console_delay_seconds   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.datastore_regex         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.host_ip                 = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.host_password           = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.host_port               = 443 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.host_username           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.insecure                = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.integration_bridge      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.maximum_objects         = 100 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.pbm_default_policy      = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.pbm_enabled             = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.pbm_wsdl_location       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.serial_port_proxy_uri   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.serial_port_service_uri = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.task_poll_interval      = 0.5 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.use_linked_clone        = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.vnc_keymap              = en-us {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.vnc_port                = 5900 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vmware.vnc_port_total          = 10000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.auth_schemes               = ['none'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.enabled                    = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.novncproxy_port            = 6080 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.vencrypt_ca_certs          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.vencrypt_client_cert       = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vnc.vencrypt_client_key        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.disable_rootwrap   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.enable_numa_live_migration = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.libvirt_disable_apic = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.client_socket_timeout     = 900 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.default_pool_size         = 1000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.keep_alive                = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.max_header_line           = 16384 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.ssl_ca_file               = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.ssl_cert_file             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.ssl_key_file              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.tcp_keepidle              = 600 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] zvm.ca_file                    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] zvm.cloud_connector_url        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] zvm.reachable_timeout          = 300 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.enforce_new_defaults = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.enforce_scope      = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.policy_default_rule = default {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.connection_string     = messaging:// {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.enabled               = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.es_doc_type           = notification {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.es_scroll_size        = 10000 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.es_scroll_time        = 2m {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.filter_error_trace    = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.hmac_keys             = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.sentinel_service_name = mymaster {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.socket_timeout        = 0.1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.trace_requests        = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler.trace_sqlalchemy      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler_jaeger.process_tags   = {} {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler_jaeger.service_name_prefix = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] profiler_otlp.service_name_prefix = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] remote_debug.host              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] remote_debug.port              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_notifications.retry = -1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.auth_section        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.auth_type           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.cafile              = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.certfile            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.collect_timing      = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.connect_retries     = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.connect_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.endpoint_id         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.endpoint_override   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.insecure            = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.keyfile             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.max_version         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.min_version         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.region_name         = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.service_name        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.service_type        = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.split_loggers       = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.status_code_retries = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.status_code_retry_delay = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.timeout             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.valid_interfaces    = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_limit.version             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_reports.file_event_handler = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] oslo_reports.log_dir           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.group  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] vif_plug_ovs_privileged.user   = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.isolate_vif         = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] os_brick.lock_path             = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.capabilities   = [21] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.group          = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.helper_command = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] privsep_osbrick.user           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.group           = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.helper_command  = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] nova_sys_admin.user            = None {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG oslo_service.service [None req-474a9633-89ca-4002-812f-86df84483f89 None None] ******************************************************************************** {{(pid=72810) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 31 18:35:07 user nova-compute[72810]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Starting native event thread {{(pid=72810) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Starting green dispatch thread {{(pid=72810) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Starting connection event dispatch thread {{(pid=72810) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Connecting to libvirt: qemu:///system {{(pid=72810) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f68f5ff89a0> {{(pid=72810) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f68f5ff89a0> {{(pid=72810) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 31 18:35:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Connection event '1' reason 'None'
Jul 31 18:35:07 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 18:35:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.mount [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Initialising _HostMountState generation 0 {{(pid=72810) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 31 18:35:14 user nova-compute[72810]: INFO nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host capabilities <capabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <host>
Jul 31 18:35:14 user nova-compute[72810]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 31 18:35:14 user nova-compute[72810]:     <cpu>
Jul 31 18:35:14 user nova-compute[72810]:       <arch>x86_64</arch>
Jul 31 18:35:14 user nova-compute[72810]:       <model>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <microcode version='1070'/>
Jul 31 18:35:14 user nova-compute[72810]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='osxsave'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='invtsc'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='rsba'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature name='skip-l1dfl-vmentry'/>
Jul 31 18:35:14 user nova-compute[72810]:       <pages unit='KiB' size='4'/>
Jul 31 18:35:14 user nova-compute[72810]:       <pages unit='KiB' size='2048'/>
Jul 31 18:35:14 user nova-compute[72810]:     </cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <power_management>
Jul 31 18:35:14 user nova-compute[72810]:       <suspend_mem/>
Jul 31 18:35:14 user nova-compute[72810]:       <suspend_disk/>
Jul 31 18:35:14 user nova-compute[72810]:       <suspend_hybrid/>
Jul 31 18:35:14 user nova-compute[72810]:     </power_management>
Jul 31 18:35:14 user nova-compute[72810]:     <iommu support='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <migration_features>
Jul 31 18:35:14 user nova-compute[72810]:       <live/>
Jul 31 18:35:14 user nova-compute[72810]:       <uri_transports>
Jul 31 18:35:14 user nova-compute[72810]:         <uri_transport>tcp</uri_transport>
Jul 31 18:35:14 user nova-compute[72810]:         <uri_transport>rdma</uri_transport>
Jul 31 18:35:14 user nova-compute[72810]:       </uri_transports>
Jul 31 18:35:14 user nova-compute[72810]:     </migration_features>
Jul 31 18:35:14 user nova-compute[72810]:     <topology>
Jul 31 18:35:14 user nova-compute[72810]:       <cells num='2'>
Jul 31 18:35:14 user nova-compute[72810]:         <cell id='0'>
Jul 31 18:35:14 user nova-compute[72810]:           <memory unit='KiB'>8189224</memory>
Jul 31 18:35:14 user nova-compute[72810]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 31 18:35:14 user nova-compute[72810]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 18:35:14 user nova-compute[72810]:           <distances>
Jul 31 18:35:14 user nova-compute[72810]:             <sibling id='0' value='10'/>
Jul 31 18:35:14 user nova-compute[72810]:             <sibling id='1' value='20'/>
Jul 31 18:35:14 user nova-compute[72810]:           </distances>
Jul 31 18:35:14 user nova-compute[72810]:           <cpus num='6'>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 31 18:35:14 user nova-compute[72810]:           </cpus>
Jul 31 18:35:14 user nova-compute[72810]:         </cell>
Jul 31 18:35:14 user nova-compute[72810]:         <cell id='1'>
Jul 31 18:35:14 user nova-compute[72810]:           <memory unit='KiB'>8206460</memory>
Jul 31 18:35:14 user nova-compute[72810]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 31 18:35:14 user nova-compute[72810]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 18:35:14 user nova-compute[72810]:           <distances>
Jul 31 18:35:14 user nova-compute[72810]:             <sibling id='0' value='20'/>
Jul 31 18:35:14 user nova-compute[72810]:             <sibling id='1' value='10'/>
Jul 31 18:35:14 user nova-compute[72810]:           </distances>
Jul 31 18:35:14 user nova-compute[72810]:           <cpus num='6'>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 31 18:35:14 user nova-compute[72810]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 31 18:35:14 user nova-compute[72810]:           </cpus>
Jul 31 18:35:14 user nova-compute[72810]:         </cell>
Jul 31 18:35:14 user nova-compute[72810]:       </cells>
Jul 31 18:35:14 user nova-compute[72810]:     </topology>
Jul 31 18:35:14 user nova-compute[72810]:     <cache>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 31 18:35:14 user nova-compute[72810]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 31 18:35:14 user nova-compute[72810]:     </cache>
Jul 31 18:35:14 user nova-compute[72810]:     <secmodel>
Jul 31 18:35:14 user nova-compute[72810]:       <model>apparmor</model>
Jul 31 18:35:14 user nova-compute[72810]:       <doi>0</doi>
Jul 31 18:35:14 user nova-compute[72810]:     </secmodel>
Jul 31 18:35:14 user nova-compute[72810]:     <secmodel>
Jul 31 18:35:14 user nova-compute[72810]:       <model>dac</model>
Jul 31 18:35:14 user nova-compute[72810]:       <doi>0</doi>
Jul 31 18:35:14 user nova-compute[72810]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 31 18:35:14 user nova-compute[72810]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 31 18:35:14 user nova-compute[72810]:     </secmodel>
Jul 31 18:35:14 user nova-compute[72810]:   </host>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='alpha'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>clipper</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='armv6l'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>spitz</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>nuri</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>kzm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>z2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>tosa</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n810</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>terrier</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>midway</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>microbit</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>verdex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>highbank</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>akita</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>connex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>collie</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='armv7l'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>spitz</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>nuri</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>kzm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>z2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>tosa</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n810</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>terrier</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>midway</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>microbit</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>verdex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>highbank</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>akita</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>connex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>collie</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='aarch64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>spitz</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>nuri</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>kzm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>z2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>tosa</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n810</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>n800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>terrier</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>midway</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>microbit</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>verdex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>raspi3b</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>highbank</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>akita</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>connex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>collie</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <acpi default='on' toggle='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='cris'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='i686'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>isapc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>microvm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='kvm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <pae/>
Jul 31 18:35:14 user nova-compute[72810]:       <nonpae/>
Jul 31 18:35:14 user nova-compute[72810]:       <acpi default='on' toggle='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:       <apic default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='m68k'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>an5206</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>q800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>next-cube</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='microblaze'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='microblazeel'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='mips'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>malta</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='mipsel'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>malta</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='mips64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>malta</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>pica61</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>magnum</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='mips64el'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>malta</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>pica61</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>magnum</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='16'>boston</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='ppc'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mac99</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>40p</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>taihu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='ppc64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>taihu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>40p</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mac99</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='ppc64le'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>taihu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>40p</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>mac99</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='riscv32'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='8'>spike</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>opentitan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='8'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='riscv64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='8'>spike</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>shakti_c</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='8'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='s390x'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='sh4'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>shix</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>r2d</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='sh4eb'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>shix</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>r2d</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='sparc'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>SS-5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>SS-20</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>LX</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>SS-4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>SS-10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>Voyager</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='sparc64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sun4u</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>niagara</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>sun4v</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='x86_64'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>64</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='1'>isapc</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>microvm</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='kvm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <acpi default='on' toggle='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:       <apic default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='xtensa'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>sim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>kc705</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ml605</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx200</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx60</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]:   <guest>
Jul 31 18:35:14 user nova-compute[72810]:     <os_type>hvm</os_type>
Jul 31 18:35:14 user nova-compute[72810]:     <arch name='xtensaeb'>
Jul 31 18:35:14 user nova-compute[72810]:       <wordsize>32</wordsize>
Jul 31 18:35:14 user nova-compute[72810]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='4'>sim</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>kc705</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ml605</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>virt</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx200</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>lx60</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 18:35:14 user nova-compute[72810]:       <domain type='qemu'/>
Jul 31 18:35:14 user nova-compute[72810]:     </arch>
Jul 31 18:35:14 user nova-compute[72810]:     <features>
Jul 31 18:35:14 user nova-compute[72810]:       <cpuselection/>
Jul 31 18:35:14 user nova-compute[72810]:       <deviceboot/>
Jul 31 18:35:14 user nova-compute[72810]:       <disksnapshot default='on' toggle='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     </features>
Jul 31 18:35:14 user nova-compute[72810]:   </guest>
Jul 31 18:35:14 user nova-compute[72810]: </capabilities>
Jul 31 18:35:14 user nova-compute[72810]: 
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-q35-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>i686</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='288'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'/>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='lm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-i440fx-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>i686</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='255'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'/>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='lm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ide</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-q35-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>i686</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='288'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'/>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='lm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-i440fx-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>i686</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='255'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'/>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='lm'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ide</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-q35-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>x86_64</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='288'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>efi</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='invtsc'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='rsba'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-i440fx-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>x86_64</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='255'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>efi</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='invtsc'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='rsba'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ide</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-q35-jammy</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>x86_64</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='288'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>efi</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='invtsc'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='rsba'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 31 18:35:14 user nova-compute[72810]: <domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 18:35:14 user nova-compute[72810]:   <domain>kvm</domain>
Jul 31 18:35:14 user nova-compute[72810]:   <machine>pc-i440fx-6.2</machine>
Jul 31 18:35:14 user nova-compute[72810]:   <arch>x86_64</arch>
Jul 31 18:35:14 user nova-compute[72810]:   <vcpu max='255'/>
Jul 31 18:35:14 user nova-compute[72810]:   <iothreads supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:   <os supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='firmware'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>efi</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:     <loader supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>rom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pflash</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='readonly'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>yes</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='secure'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>no</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </loader>
Jul 31 18:35:14 user nova-compute[72810]:   </os>
Jul 31 18:35:14 user nova-compute[72810]:   <cpu>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-passthrough' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='hostPassthroughMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='maximum' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='maximumMigratable'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>on</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>off</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='host-model' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <vendor>Intel</vendor>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ss'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='vmx'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pcid'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='hypervisor'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arat'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='umip'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='md-clear'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='invtsc'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibpb'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='ibrs'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-stibp'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='rsba'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='erms'/>
Jul 31 18:35:14 user nova-compute[72810]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:     <mode name='custom' supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>qemu64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>qemu32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>phenom</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>pentium</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>n270</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm64</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>kvm32</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>coreduo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>core2duo</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>athlon</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Westmere</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Snowridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Skylake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>SandyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Penryn</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G5</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G4</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G3</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Opteron_G2</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Opteron_G1</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>IvyBridge</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Icelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Haswell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Rome</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-Milan</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>EPYC</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Dhyana</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cooperlake</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>Conroe</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='no'>Broadwell</model>
Jul 31 18:35:14 user nova-compute[72810]:       <model usable='yes'>486</model>
Jul 31 18:35:14 user nova-compute[72810]:     </mode>
Jul 31 18:35:14 user nova-compute[72810]:   </cpu>
Jul 31 18:35:14 user nova-compute[72810]:   <memoryBacking supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:     <enum name='sourceType'>
Jul 31 18:35:14 user nova-compute[72810]:       <value>file</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>anonymous</value>
Jul 31 18:35:14 user nova-compute[72810]:       <value>memfd</value>
Jul 31 18:35:14 user nova-compute[72810]:     </enum>
Jul 31 18:35:14 user nova-compute[72810]:   </memoryBacking>
Jul 31 18:35:14 user nova-compute[72810]:   <devices>
Jul 31 18:35:14 user nova-compute[72810]:     <disk supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='diskDevice'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>disk</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cdrom</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>floppy</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>lun</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='bus'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ide</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>fdc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sata</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </disk>
Jul 31 18:35:14 user nova-compute[72810]:     <graphics supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='type'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>sdl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vnc</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>spice</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egl-headless</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </graphics>
Jul 31 18:35:14 user nova-compute[72810]:     <video supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='modelType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>cirrus</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>vmvga</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>qxl</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>none</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>bochs</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>ramfb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </video>
Jul 31 18:35:14 user nova-compute[72810]:     <hostdev supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='mode'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>subsystem</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='startupPolicy'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>default</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>mandatory</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>requisite</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>optional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='subsysType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>usb</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>pci</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>scsi</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='capsType'/>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='pciBackend'/>
Jul 31 18:35:14 user nova-compute[72810]:     </hostdev>
Jul 31 18:35:14 user nova-compute[72810]:     <rng supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtio-non-transitional</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>random</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>egd</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>builtin</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </rng>
Jul 31 18:35:14 user nova-compute[72810]:     <filesystem supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='driverType'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>path</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>handle</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>virtiofs</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </filesystem>
Jul 31 18:35:14 user nova-compute[72810]:     <tpm supported='yes'>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='model'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-tis</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>tpm-crb</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:       <enum name='backendModel'>
Jul 31 18:35:14 user nova-compute[72810]:         <value>passthrough</value>
Jul 31 18:35:14 user nova-compute[72810]:         <value>emulator</value>
Jul 31 18:35:14 user nova-compute[72810]:       </enum>
Jul 31 18:35:14 user nova-compute[72810]:     </tpm>
Jul 31 18:35:14 user nova-compute[72810]:   </devices>
Jul 31 18:35:14 user nova-compute[72810]:   <features>
Jul 31 18:35:14 user nova-compute[72810]:     <gic supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:     <vmcoreinfo supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <genid supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backingStoreInput supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <backup supported='yes'/>
Jul 31 18:35:14 user nova-compute[72810]:     <sev supported='no'/>
Jul 31 18:35:14 user nova-compute[72810]:   </features>
Jul 31 18:35:14 user nova-compute[72810]: </domainCapabilities>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72810) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72810) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Checking secure boot support for host arch (x86_64) {{(pid=72810) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 18:35:14 user nova-compute[72810]: INFO nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Secure Boot support detected
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] cpu compare xml: <cpu match="exact">
Jul 31 18:35:14 user nova-compute[72810]:   <model>Nehalem</model>
Jul 31 18:35:14 user nova-compute[72810]: </cpu>
Jul 31 18:35:14 user nova-compute[72810]:  {{(pid=72810) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 31 18:35:14 user nova-compute[72810]: INFO nova.virt.node [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Generated node identity 1f952763-889d-4346-89af-cc061f930545
Jul 31 18:35:14 user nova-compute[72810]: INFO nova.virt.node [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Wrote node identity 1f952763-889d-4346-89af-cc061f930545 to /opt/stack/data/nova/compute_id
Jul 31 18:35:14 user nova-compute[72810]: WARNING nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Compute nodes ['1f952763-889d-4346-89af-cc061f930545'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 31 18:35:14 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 31 18:35:14 user nova-compute[72810]: WARNING nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 18:35:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:35:14 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:35:15 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:35:15 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Hypervisor/Node resource view: name=user free_ram=10894MB free_disk=26.290069580078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:35:15 user nova-compute[72810]: WARNING nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] No compute node record for user:1f952763-889d-4346-89af-cc061f930545: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 1f952763-889d-4346-89af-cc061f930545 could not be found.
Jul 31 18:35:15 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Compute node record created for user:user with uuid: 1f952763-889d-4346-89af-cc061f930545
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:35:15 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [req-e4fcac9d-7cad-4ff8-9652-c1fc7904ee12] Created resource provider record via placement API for resource provider with UUID 1f952763-889d-4346-89af-cc061f930545 and name user.
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72810) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 31 18:35:15 user nova-compute[72810]: INFO nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] kernel doesn't support AMD SEV
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Libvirt baseline CPU <cpu>
Jul 31 18:35:15 user nova-compute[72810]:   <arch>x86_64</arch>
Jul 31 18:35:15 user nova-compute[72810]:   <model>Nehalem</model>
Jul 31 18:35:15 user nova-compute[72810]:   <vendor>Intel</vendor>
Jul 31 18:35:15 user nova-compute[72810]:   <topology sockets="6" cores="1" threads="1"/>
Jul 31 18:35:15 user nova-compute[72810]: </cpu>
Jul 31 18:35:15 user nova-compute[72810]:  {{(pid=72810) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Updated inventory for provider 1f952763-889d-4346-89af-cc061f930545 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Updating resource provider 1f952763-889d-4346-89af-cc061f930545 generation from 0 to 1 during operation: update_inventory {{(pid=72810) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Updating resource provider 1f952763-889d-4346-89af-cc061f930545 generation from 1 to 2 during operation: update_traits {{(pid=72810) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.service [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Creating RPC server for service compute {{(pid=72810) start /opt/stack/nova/nova/service.py:182}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.service [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Join ServiceGroup membership for this service compute {{(pid=72810) start /opt/stack/nova/nova/service.py:199}}
Jul 31 18:35:15 user nova-compute[72810]: DEBUG nova.servicegroup.drivers.db [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72810) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 31 18:35:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:35:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:36:06 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:36:07 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:36:07 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=10252MB free_disk=26.194000244140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:37:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:37:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:37:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=10200MB free_disk=26.239822387695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:37:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:37:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:38:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:38:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:38:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.013267517089844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:38:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:39:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=9493MB free_disk=26.044570922851562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:39:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:24 user nova-compute[72810]: INFO nova.compute.claims [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Claim successful on node user
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.270s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:25 user nova-compute[72810]: INFO nova.compute.claims [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Claim successful on node user
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Creating image(s)
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.policy [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a818426c4f424127a01cb9f57e076603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38248d933d4d42a9aca885b10fbd1afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.part --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.virt.images [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] 0efe86ed-5b8c-473b-b5ee-c879a1eae6b6 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.part /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:26 user nova-compute[72810]: INFO nova.compute.claims [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Claim successful on node user
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Creating image(s)
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "/opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "/opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "/opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.part /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.converted" returned: 0 in 0.175s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.policy [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '783d7b552b7e4af3a80c428ecc806685', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac677c760547ef93b8d0ab9da05981', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.934s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:26 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbb5iv9_v/privsep.sock']
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.236s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:26 user sudo[82007]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbb5iv9_v/privsep.sock
Jul 31 18:39:26 user sudo[82007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Creating image(s)
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.policy [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf8b9f2a471b40b7ba541f9da121207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3897e37c484827819b5d56cee9345a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:27 user nova-compute[72810]: INFO nova.compute.claims [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Claim successful on node user
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.636s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.149s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:27 user nova-compute[72810]: INFO nova.compute.claims [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Claim successful on node user
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Creating image(s)
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "/opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:28 user sudo[82007]: pam_unix(sudo:session): session closed for user root
Jul 31 18:39:28 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Spawned new privsep daemon via rootwrap
Jul 31 18:39:28 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 18:39:28 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 18:39:28 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 31 18:39:28 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82010
Jul 31 18:39:28 user nova-compute[72810]: WARNING oslo_privsep.priv_context [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] privsep daemon already running
Jul 31 18:39:28 user nova-compute[72810]: WARNING oslo_privsep.priv_context [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] privsep daemon already running
Jul 31 18:39:28 user nova-compute[72810]: WARNING oslo_privsep.priv_context [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] privsep daemon already running
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.policy [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84386ba984b649c69a4a1110fe7954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ba7112dc8b41f8aad49ea1ce030afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Creating image(s)
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.231s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.206s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.179s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.176s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.policy [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf8b9f2a471b40b7ba541f9da121207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3897e37c484827819b5d56cee9345a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:28 user nova-compute[72810]: INFO nova.compute.claims [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Claim successful on node user
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk 1073741824" returned: 0 in 0.048s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.207s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.217s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk 1073741824" returned: 0 in 0.079s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.471s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Successfully created port: d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Cannot resize image /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lazy-loading 'migration_context' on Instance uuid 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Successfully created port: befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Ensure instance console log exists: /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Successfully created port: 54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk 1073741824" returned: 0 in 0.049s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.689s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Cannot resize image /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Ensure instance console log exists: /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.797s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk 1073741824" returned: 0 in 0.222s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.110s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Cannot resize image /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'migration_context' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Ensure instance console log exists: /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.173s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Creating image(s)
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk 1073741824" returned: 0 in 0.075s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Cannot resize image /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'migration_context' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Ensure instance console log exists: /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.172s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.177s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.policy [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13def89025e84e98a4ed596c16e0d0ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be7d23c4eb74c43a79711e7253b436c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Cannot resize image /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Ensure instance console log exists: /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk 1073741824" returned: 0 in 0.050s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Cannot resize image /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'migration_context' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Ensure instance console log exists: /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Successfully updated port: 54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-changed-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing instance network info cache due to event network-changed-54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Successfully created port: 35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Successfully updated port: befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquired lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Successfully created port: 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance network_info: |[{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-changed-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Refreshing instance network info cache due to event network-changed-befbef71-58cd-40ae-b0c7-4b1c7265ab1c. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] Acquiring lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing network info cache for port 54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start _get_guest_xml network_info=[{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-2077201862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:32 user nova-compute[72810]:   <uuid>1e9cae76-2122-436a-868b-bb8c500abfe1</uuid>
Jul 31 18:39:32 user nova-compute[72810]:   <name>instance-00000001</name>
Jul 31 18:39:32 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:32 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:32 user nova-compute[72810]:   <metadata>
Jul 31 18:39:32 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:32 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherA-server-2077201862</nova:name>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:32</nova:creationTime>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:32 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:32 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:user uuid="a818426c4f424127a01cb9f57e076603">tempest-ServerActionsTestOtherA-1074391512-project-member</nova:user>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:project uuid="38248d933d4d42a9aca885b10fbd1afa">tempest-ServerActionsTestOtherA-1074391512</nova:project>
Jul 31 18:39:32 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:32 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:32 user nova-compute[72810]:         <nova:port uuid="54438c8e-25a3-411a-b897-df13142f4016">
Jul 31 18:39:32 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 18:39:32 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:32 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:32 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:32 user nova-compute[72810]:   </metadata>
Jul 31 18:39:32 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:32 user nova-compute[72810]:     <system>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="serial">1e9cae76-2122-436a-868b-bb8c500abfe1</entry>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="uuid">1e9cae76-2122-436a-868b-bb8c500abfe1</entry>
Jul 31 18:39:32 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:32 user nova-compute[72810]:     </system>
Jul 31 18:39:32 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:32 user nova-compute[72810]:   <os>
Jul 31 18:39:32 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:32 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:32 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:32 user nova-compute[72810]:   </os>
Jul 31 18:39:32 user nova-compute[72810]:   <features>
Jul 31 18:39:32 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:32 user nova-compute[72810]:     <apic/>
Jul 31 18:39:32 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:32 user nova-compute[72810]:   </features>
Jul 31 18:39:32 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:32 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:32 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:32 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:32 user nova-compute[72810]:   </clock>
Jul 31 18:39:32 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:32 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:32 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:32 user nova-compute[72810]:   </cpu>
Jul 31 18:39:32 user nova-compute[72810]:   <devices>
Jul 31 18:39:32 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:32 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:32 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk"/>
Jul 31 18:39:32 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:32 user nova-compute[72810]:     </disk>
Jul 31 18:39:32 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:32 user nova-compute[72810]:       <mac address="fa:16:3e:03:73:f1"/>
Jul 31 18:39:32 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:32 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:32 user nova-compute[72810]:       <target dev="tap54438c8e-25"/>
Jul 31 18:39:32 user nova-compute[72810]:     </interface>
Jul 31 18:39:32 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:32 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/console.log" append="off"/>
Jul 31 18:39:32 user nova-compute[72810]:     </serial>
Jul 31 18:39:32 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:32 user nova-compute[72810]:     <video>
Jul 31 18:39:32 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:32 user nova-compute[72810]:     </video>
Jul 31 18:39:32 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:32 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:32 user nova-compute[72810]:     </rng>
Jul 31 18:39:32 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:32 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:32 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:32 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:32 user nova-compute[72810]:   </devices>
Jul 31 18:39:32 user nova-compute[72810]: </domain>
Jul 31 18:39:32 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-2077201862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG os_vif [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Created schema index Interface.name {{(pid=72810) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Created schema index Port.name {{(pid=72810) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Created schema index Bridge.name {{(pid=72810) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [POLLOUT] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:32 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpg_p6ol3n/privsep.sock']
Jul 31 18:39:32 user sudo[82114]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpg_p6ol3n/privsep.sock
Jul 31 18:39:32 user sudo[82114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:33 user nova-compute[72810]: INFO nova.compute.claims [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Claim successful on node user
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating instance_info_cache with network_info: [{"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Releasing lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Instance network_info: |[{"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] Acquired lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Refreshing network info cache for port befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Start _get_guest_xml network_info=[{"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1506770794',display_name='tempest-DeleteServersTestJSON-server-1506770794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1506770794',id=2,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceac677c760547ef93b8d0ab9da05981',ramdisk_id='',reservation_id='r-uufnxwaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-827250694',owner_user_name='tempest-DeleteServersTestJSON-827250694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:26Z,user_data=None,user_id='783d7b552b7e4af3a80c428ecc806685',uuid=632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converting VIF {"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lazy-loading 'pci_devices' on Instance uuid 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:33 user nova-compute[72810]:   <uuid>632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11</uuid>
Jul 31 18:39:33 user nova-compute[72810]:   <name>instance-00000002</name>
Jul 31 18:39:33 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:33 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:33 user nova-compute[72810]:   <metadata>
Jul 31 18:39:33 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:33 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:name>tempest-DeleteServersTestJSON-server-1506770794</nova:name>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:33</nova:creationTime>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:33 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:33 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:user uuid="783d7b552b7e4af3a80c428ecc806685">tempest-DeleteServersTestJSON-827250694-project-member</nova:user>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:project uuid="ceac677c760547ef93b8d0ab9da05981">tempest-DeleteServersTestJSON-827250694</nova:project>
Jul 31 18:39:33 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:33 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:33 user nova-compute[72810]:         <nova:port uuid="befbef71-58cd-40ae-b0c7-4b1c7265ab1c">
Jul 31 18:39:33 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:39:33 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:33 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:33 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:33 user nova-compute[72810]:   </metadata>
Jul 31 18:39:33 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:33 user nova-compute[72810]:     <system>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="serial">632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11</entry>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="uuid">632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11</entry>
Jul 31 18:39:33 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:33 user nova-compute[72810]:     </system>
Jul 31 18:39:33 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:33 user nova-compute[72810]:   <os>
Jul 31 18:39:33 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:33 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:33 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:33 user nova-compute[72810]:   </os>
Jul 31 18:39:33 user nova-compute[72810]:   <features>
Jul 31 18:39:33 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:33 user nova-compute[72810]:     <apic/>
Jul 31 18:39:33 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:33 user nova-compute[72810]:   </features>
Jul 31 18:39:33 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:33 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:33 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:33 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:33 user nova-compute[72810]:   </clock>
Jul 31 18:39:33 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:33 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:33 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:33 user nova-compute[72810]:   </cpu>
Jul 31 18:39:33 user nova-compute[72810]:   <devices>
Jul 31 18:39:33 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:33 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:33 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk"/>
Jul 31 18:39:33 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:33 user nova-compute[72810]:     </disk>
Jul 31 18:39:33 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:33 user nova-compute[72810]:       <mac address="fa:16:3e:da:0a:19"/>
Jul 31 18:39:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:33 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:33 user nova-compute[72810]:       <target dev="tapbefbef71-58"/>
Jul 31 18:39:33 user nova-compute[72810]:     </interface>
Jul 31 18:39:33 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:33 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/console.log" append="off"/>
Jul 31 18:39:33 user nova-compute[72810]:     </serial>
Jul 31 18:39:33 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:33 user nova-compute[72810]:     <video>
Jul 31 18:39:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:33 user nova-compute[72810]:     </video>
Jul 31 18:39:33 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:33 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:33 user nova-compute[72810]:     </rng>
Jul 31 18:39:33 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:33 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:33 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:33 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:33 user nova-compute[72810]:   </devices>
Jul 31 18:39:33 user nova-compute[72810]: </domain>
Jul 31 18:39:33 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1506770794',display_name='tempest-DeleteServersTestJSON-server-1506770794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1506770794',id=2,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ceac677c760547ef93b8d0ab9da05981',ramdisk_id='',reservation_id='r-uufnxwaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-827250694',owner_user_name='tempest-DeleteServersTestJSON-827250694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:26Z,user_data=None,user_id='783d7b552b7e4af3a80c428ecc806685',uuid=632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converting VIF {"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG os_vif [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updated VIF entry in instance network info cache for port 54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b328f73b-8eb0-4326-b8ae-a61df3559a5c req-c7497a9f-c3fa-4341-b5f0-8eeead3f0689 service nova] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.policy [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b274199e036644afba90b84bd12b0f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb070b24ed34fb6b3f310d3fae39942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:34 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Creating image(s)
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "/opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "/opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "/opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Successfully created port: 8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Successfully updated port: d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.175s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk 1073741824" returned: 0 in 0.045s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:34 user sudo[82114]: pam_unix(sudo:session): session closed for user root
Jul 31 18:39:34 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Spawned new privsep daemon via rootwrap
Jul 31 18:39:34 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 18:39:34 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 18:39:34 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 31 18:39:34 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82121
Jul 31 18:39:34 user nova-compute[72810]: WARNING oslo_privsep.priv_context [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] privsep daemon already running
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Cannot resize image /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'migration_context' on Instance uuid d164c447-f733-4779-ad93-1f6e9b4bb72c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Ensure instance console log exists: /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-changed-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Refreshing instance network info cache due to event network-changed-d26e6cf1-fb0d-4592-bd29-d26190c47b99. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:35 user nova-compute[72810]: INFO nova.compute.claims [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Claim successful on node user
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updated VIF entry in instance network info cache for port befbef71-58cd-40ae-b0c7-4b1c7265ab1c. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating instance_info_cache with network_info: [{"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ddeb6d4-8acd-442b-87de-a04af760018f req-e32c0ce9-599d-4b6c-bb1e-64f4cd8664c2 service nova] Releasing lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbefbef71-58, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbefbef71-58, col_values=(('external_ids', {'iface-id': 'befbef71-58cd-40ae-b0c7-4b1c7265ab1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:0a:19', 'vm-uuid': '632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: INFO os_vif [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58')
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54438c8e-25, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54438c8e-25, col_values=(('external_ids', {'iface-id': '54438c8e-25a3-411a-b897-df13142f4016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:73:f1', 'vm-uuid': '1e9cae76-2122-436a-868b-bb8c500abfe1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:35 user nova-compute[72810]: INFO os_vif [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25')
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No VIF found with MAC fa:16:3e:03:73:f1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] No VIF found with MAC fa:16:3e:da:0a:19, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Successfully created port: a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Creating image(s)
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG nova.policy [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b2bbbd7a792431688c8d575d2c71d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a633ca9965410aa6ce5b2b86a6f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk 1073741824" returned: 0 in 0.055s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Cannot resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'migration_context' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Ensure instance console log exists: /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance network_info: |[{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Refreshing network info cache for port d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start _get_guest_xml network_info=[{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2023309342',display_name='tempest-ServerRescueNegativeTestJSON-server-2023309342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2023309342',id=3,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-dzqw94br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:27Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=d138fb7b-7969-4099-8e54-dfd892738660,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.objects.instance [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:37 user nova-compute[72810]:   <uuid>d138fb7b-7969-4099-8e54-dfd892738660</uuid>
Jul 31 18:39:37 user nova-compute[72810]:   <name>instance-00000003</name>
Jul 31 18:39:37 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:37 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:37 user nova-compute[72810]:   <metadata>
Jul 31 18:39:37 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:37 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2023309342</nova:name>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:37</nova:creationTime>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:37 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:37 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:39:37 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:37 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:37 user nova-compute[72810]:         <nova:port uuid="d26e6cf1-fb0d-4592-bd29-d26190c47b99">
Jul 31 18:39:37 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 18:39:37 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:37 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:37 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:37 user nova-compute[72810]:   </metadata>
Jul 31 18:39:37 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:37 user nova-compute[72810]:     <system>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="serial">d138fb7b-7969-4099-8e54-dfd892738660</entry>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="uuid">d138fb7b-7969-4099-8e54-dfd892738660</entry>
Jul 31 18:39:37 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:37 user nova-compute[72810]:     </system>
Jul 31 18:39:37 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:37 user nova-compute[72810]:   <os>
Jul 31 18:39:37 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:37 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:37 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:37 user nova-compute[72810]:   </os>
Jul 31 18:39:37 user nova-compute[72810]:   <features>
Jul 31 18:39:37 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:37 user nova-compute[72810]:     <apic/>
Jul 31 18:39:37 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:37 user nova-compute[72810]:   </features>
Jul 31 18:39:37 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:37 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:37 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:37 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:37 user nova-compute[72810]:   </clock>
Jul 31 18:39:37 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:37 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:37 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:37 user nova-compute[72810]:   </cpu>
Jul 31 18:39:37 user nova-compute[72810]:   <devices>
Jul 31 18:39:37 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:37 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:37 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk"/>
Jul 31 18:39:37 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:37 user nova-compute[72810]:     </disk>
Jul 31 18:39:37 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:37 user nova-compute[72810]:       <mac address="fa:16:3e:2a:f7:ad"/>
Jul 31 18:39:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:37 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:37 user nova-compute[72810]:       <target dev="tapd26e6cf1-fb"/>
Jul 31 18:39:37 user nova-compute[72810]:     </interface>
Jul 31 18:39:37 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:37 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/console.log" append="off"/>
Jul 31 18:39:37 user nova-compute[72810]:     </serial>
Jul 31 18:39:37 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:37 user nova-compute[72810]:     <video>
Jul 31 18:39:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:37 user nova-compute[72810]:     </video>
Jul 31 18:39:37 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:37 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:37 user nova-compute[72810]:     </rng>
Jul 31 18:39:37 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:37 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:37 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:37 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:37 user nova-compute[72810]:   </devices>
Jul 31 18:39:37 user nova-compute[72810]: </domain>
Jul 31 18:39:37 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2023309342',display_name='tempest-ServerRescueNegativeTestJSON-server-2023309342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2023309342',id=3,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-dzqw94br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:27Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=d138fb7b-7969-4099-8e54-dfd892738660,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG os_vif [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd26e6cf1-fb, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd26e6cf1-fb, col_values=(('external_ids', {'iface-id': 'd26e6cf1-fb0d-4592-bd29-d26190c47b99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:f7:ad', 'vm-uuid': 'd138fb7b-7969-4099-8e54-dfd892738660'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Successfully updated port: a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:37 user nova-compute[72810]: INFO os_vif [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb')
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquired lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:2a:f7:ad, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Successfully created port: e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-changed-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Refreshing instance network info cache due to event network-changed-a1476142-9922-4e4a-8d94-356504c1bc7b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] Acquiring lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Successfully updated port: 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquired lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-changed-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Refreshing instance network info cache due to event network-changed-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] Acquiring lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updating instance_info_cache with network_info: [{"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Releasing lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance network_info: |[{"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] Acquired lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.neutron [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Refreshing network info cache for port a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Start _get_guest_xml network_info=[{"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-394772738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394772738',id=7,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGab8oF0eScS1hdCvRC/2fY4gHOK31K9nCdwYQY7kSd8mZ6BEd4pOCTP5Ns/AKdTOz7X6wF4nIkp8YlBGwFTJ7B3GyZJURYQx/doK0yFkDuqS4zNkGoDEKQt3Rf8Eew8g==',key_name='tempest-keypair-1002542927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-sojd5jv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=d164c447-f733-4779-ad93-1f6e9b4bb72c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'pci_devices' on Instance uuid d164c447-f733-4779-ad93-1f6e9b4bb72c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Successfully updated port: 35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:38 user nova-compute[72810]:   <uuid>d164c447-f733-4779-ad93-1f6e9b4bb72c</uuid>
Jul 31 18:39:38 user nova-compute[72810]:   <name>instance-00000007</name>
Jul 31 18:39:38 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:38 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:38 user nova-compute[72810]:   <metadata>
Jul 31 18:39:38 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:38 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:name>tempest-ServerActionsV293TestJSON-server-394772738</nova:name>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:38</nova:creationTime>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:38 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:38 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:user uuid="b274199e036644afba90b84bd12b0f5b">tempest-ServerActionsV293TestJSON-373314597-project-member</nova:user>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:project uuid="1cb070b24ed34fb6b3f310d3fae39942">tempest-ServerActionsV293TestJSON-373314597</nova:project>
Jul 31 18:39:38 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:38 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:38 user nova-compute[72810]:         <nova:port uuid="a1476142-9922-4e4a-8d94-356504c1bc7b">
Jul 31 18:39:38 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 18:39:38 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:38 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:38 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:38 user nova-compute[72810]:   </metadata>
Jul 31 18:39:38 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:38 user nova-compute[72810]:     <system>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="serial">d164c447-f733-4779-ad93-1f6e9b4bb72c</entry>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="uuid">d164c447-f733-4779-ad93-1f6e9b4bb72c</entry>
Jul 31 18:39:38 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:38 user nova-compute[72810]:     </system>
Jul 31 18:39:38 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:38 user nova-compute[72810]:   <os>
Jul 31 18:39:38 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:38 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:38 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:38 user nova-compute[72810]:   </os>
Jul 31 18:39:38 user nova-compute[72810]:   <features>
Jul 31 18:39:38 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:38 user nova-compute[72810]:     <apic/>
Jul 31 18:39:38 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:38 user nova-compute[72810]:   </features>
Jul 31 18:39:38 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:38 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:38 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:38 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:38 user nova-compute[72810]:   </clock>
Jul 31 18:39:38 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:38 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:38 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:38 user nova-compute[72810]:   </cpu>
Jul 31 18:39:38 user nova-compute[72810]:   <devices>
Jul 31 18:39:38 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:38 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:38 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk"/>
Jul 31 18:39:38 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:38 user nova-compute[72810]:     </disk>
Jul 31 18:39:38 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:38 user nova-compute[72810]:       <mac address="fa:16:3e:58:4d:ed"/>
Jul 31 18:39:38 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:38 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:38 user nova-compute[72810]:       <target dev="tapa1476142-99"/>
Jul 31 18:39:38 user nova-compute[72810]:     </interface>
Jul 31 18:39:38 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:38 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/console.log" append="off"/>
Jul 31 18:39:38 user nova-compute[72810]:     </serial>
Jul 31 18:39:38 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:38 user nova-compute[72810]:     <video>
Jul 31 18:39:38 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:38 user nova-compute[72810]:     </video>
Jul 31 18:39:38 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:38 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:38 user nova-compute[72810]:     </rng>
Jul 31 18:39:38 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:38 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:38 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:38 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:38 user nova-compute[72810]:   </devices>
Jul 31 18:39:38 user nova-compute[72810]: </domain>
Jul 31 18:39:38 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-394772738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394772738',id=7,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGab8oF0eScS1hdCvRC/2fY4gHOK31K9nCdwYQY7kSd8mZ6BEd4pOCTP5Ns/AKdTOz7X6wF4nIkp8YlBGwFTJ7B3GyZJURYQx/doK0yFkDuqS4zNkGoDEKQt3Rf8Eew8g==',key_name='tempest-keypair-1002542927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-sojd5jv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=d164c447-f733-4779-ad93-1f6e9b4bb72c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG os_vif [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1476142-99, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1476142-99, col_values=(('external_ids', {'iface-id': 'a1476142-9922-4e4a-8d94-356504c1bc7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:4d:ed', 'vm-uuid': 'd164c447-f733-4779-ad93-1f6e9b4bb72c'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:38 user nova-compute[72810]: INFO os_vif [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99')
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No VIF found with MAC fa:16:3e:58:4d:ed, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.compute.manager [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:38 user nova-compute[72810]: DEBUG nova.compute.manager [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:38 user nova-compute[72810]: WARNING nova.compute.manager [req-281d34cd-4c82-47f3-8ed4-e697afb57f7b req-e0c3562b-011b-4c47-8e75-98bb58299675 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state building and task_state spawning.
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updated VIF entry in instance network info cache for port a1476142-9922-4e4a-8d94-356504c1bc7b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updating instance_info_cache with network_info: [{"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0d42a540-8cf7-44f0-8874-d5a67f993572 req-170004fc-aee3-4a7d-a79b-b86682d43a64 service nova] Releasing lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Releasing lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Instance network_info: |[{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] Acquired lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Refreshing network info cache for port 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Start _get_guest_xml network_info=[{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-172480222',display_name='tempest-AttachVolumeNegativeTest-server-172480222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-172480222',id=4,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiw9KgdEHmbTOPWBew+ypFhZnOJjhuVew51sHq5clwAwxjWAPr0dhXqW6jr17xw5wEokug5sngwiuwKWMbIKxvmrrG3oquhXXo+ymPj1vpNeWuG1OgkWFkzJwcY9EeO2w==',key_name='tempest-keypair-586305175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-jh30hbeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=98baf3f0-aed9-4075-a77b-ed6b697e5bc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'pci_devices' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updated VIF entry in instance network info cache for port d26e6cf1-fb0d-4592-bd29-d26190c47b99. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:39 user nova-compute[72810]:   <uuid>98baf3f0-aed9-4075-a77b-ed6b697e5bc6</uuid>
Jul 31 18:39:39 user nova-compute[72810]:   <name>instance-00000004</name>
Jul 31 18:39:39 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:39 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:39 user nova-compute[72810]:   <metadata>
Jul 31 18:39:39 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:39 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeNegativeTest-server-172480222</nova:name>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:39</nova:creationTime>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:39 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:39 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:user uuid="84386ba984b649c69a4a1110fe7954dc">tempest-AttachVolumeNegativeTest-1544720465-project-member</nova:user>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:project uuid="d4ba7112dc8b41f8aad49ea1ce030afb">tempest-AttachVolumeNegativeTest-1544720465</nova:project>
Jul 31 18:39:39 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:39 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:39 user nova-compute[72810]:         <nova:port uuid="123789e9-5b8a-44f1-9aa6-30ebd5a9cccd">
Jul 31 18:39:39 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 18:39:39 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:39 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:39 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:39 user nova-compute[72810]:   </metadata>
Jul 31 18:39:39 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:39 user nova-compute[72810]:     <system>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="serial">98baf3f0-aed9-4075-a77b-ed6b697e5bc6</entry>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="uuid">98baf3f0-aed9-4075-a77b-ed6b697e5bc6</entry>
Jul 31 18:39:39 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:39 user nova-compute[72810]:     </system>
Jul 31 18:39:39 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:39 user nova-compute[72810]:   <os>
Jul 31 18:39:39 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:39 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:39 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:39 user nova-compute[72810]:   </os>
Jul 31 18:39:39 user nova-compute[72810]:   <features>
Jul 31 18:39:39 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:39 user nova-compute[72810]:     <apic/>
Jul 31 18:39:39 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:39 user nova-compute[72810]:   </features>
Jul 31 18:39:39 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:39 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:39 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:39 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:39 user nova-compute[72810]:   </clock>
Jul 31 18:39:39 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:39 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:39 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:39 user nova-compute[72810]:   </cpu>
Jul 31 18:39:39 user nova-compute[72810]:   <devices>
Jul 31 18:39:39 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:39 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:39 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk"/>
Jul 31 18:39:39 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:39 user nova-compute[72810]:     </disk>
Jul 31 18:39:39 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:39 user nova-compute[72810]:       <mac address="fa:16:3e:01:76:d6"/>
Jul 31 18:39:39 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:39 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:39 user nova-compute[72810]:       <target dev="tap123789e9-5b"/>
Jul 31 18:39:39 user nova-compute[72810]:     </interface>
Jul 31 18:39:39 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:39 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/console.log" append="off"/>
Jul 31 18:39:39 user nova-compute[72810]:     </serial>
Jul 31 18:39:39 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:39 user nova-compute[72810]:     <video>
Jul 31 18:39:39 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:39 user nova-compute[72810]:     </video>
Jul 31 18:39:39 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:39 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:39 user nova-compute[72810]:     </rng>
Jul 31 18:39:39 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:39 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:39 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:39 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:39 user nova-compute[72810]:   </devices>
Jul 31 18:39:39 user nova-compute[72810]: </domain>
Jul 31 18:39:39 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-172480222',display_name='tempest-AttachVolumeNegativeTest-server-172480222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-172480222',id=4,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiw9KgdEHmbTOPWBew+ypFhZnOJjhuVew51sHq5clwAwxjWAPr0dhXqW6jr17xw5wEokug5sngwiuwKWMbIKxvmrrG3oquhXXo+ymPj1vpNeWuG1OgkWFkzJwcY9EeO2w==',key_name='tempest-keypair-586305175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-jh30hbeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=98baf3f0-aed9-4075-a77b-ed6b697e5bc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG os_vif [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f1aac7df-cdcc-468d-8549-2ee91be15cbd req-4ed8a894-0e42-494f-a401-af8c4e4fb553 service nova] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap123789e9-5b, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap123789e9-5b, col_values=(('external_ids', {'iface-id': '123789e9-5b8a-44f1-9aa6-30ebd5a9cccd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:76:d6', 'vm-uuid': '98baf3f0-aed9-4075-a77b-ed6b697e5bc6'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Successfully updated port: 8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: INFO os_vif [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b')
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:01:76:d6, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-changed-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Refreshing instance network info cache due to event network-changed-35fdd52e-a504-49c3-aad2-a8ef4e018b97. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Acquiring lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance network_info: |[{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Acquired lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Refreshing network info cache for port 35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start _get_guest_xml network_info=[{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Successfully updated port: e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] No waiting events found dispatching network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:40 user nova-compute[72810]: WARNING nova.compute.manager [req-1e8340eb-e661-4c6e-9d2e-6f827b3f8ccf req-bb7495a4-0911-45d9-9c4e-815d14a04b85 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received unexpected event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c for instance with vm_state building and task_state spawning.
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance network_info: |[{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start _get_guest_xml network_info=[{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:41 user nova-compute[72810]: WARNING nova.compute.manager [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state building and task_state spawning.
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-changed-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Refreshing instance network info cache due to event network-changed-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updated VIF entry in instance network info cache for port 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35f2f89d-801e-4880-a320-aef878bd739a req-0c1bc7a8-2f3e-4c3b-a1ea-d395ed3ae23c service nova] Releasing lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updated VIF entry in instance network info cache for port 35fdd52e-a504-49c3-aad2-a8ef4e018b97. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Releasing lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-changed-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Refreshing instance network info cache due to event network-changed-8f869796-d849-427e-91fe-d54efcdb4674. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Refreshing network info cache for port 8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance network_info: |[{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Refreshing network info cache for port e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start _get_guest_xml network_info=[{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updated VIF entry in instance network info cache for port 8f869796-d849-427e-91fe-d54efcdb4674. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d16066a-0935-42bc-af58-99a475af482f req-dbd76989-054c-4fe7-a952-40d1093893bd service nova] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updated VIF entry in instance network info cache for port e0013d9f-8ad7-4d9e-8874-6987d6db9c9c. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:42 user nova-compute[72810]: WARNING nova.compute.manager [req-fb6fa57f-c9c9-4eb8-8379-d2c1c35cb7ca req-8d679c4e-07e0-4a2f-9122-9efc6af54474 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state building and task_state spawning.
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7509d743-91f4-43ab-9e0d-d1f03b9d8798 req-8ca45e01-5129-4e1a-85be-928aeb1f05a7 service nova] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] No waiting events found dispatching network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:42 user nova-compute[72810]: WARNING nova.compute.manager [req-5d7ff399-5be8-4533-981c-a10b1e0ca6ea req-718bde8b-e343-40e1-bad1-59f7ffb117b5 service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received unexpected event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c for instance with vm_state building and task_state spawning.
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.015s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.compute.manager [req-a2226d4a-6fbb-42e2-8adb-79ac4f7b6db4 req-d98af365-8799-4f19-b6f0-d8127dbb6473 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state building and task_state spawning.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828784.5959208, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Resumed (Lifecycle Event)
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.compute.claims [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Claim successful on node user
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance spawned successfully.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] No waiting events found dispatching network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received unexpected event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd for instance with vm_state building and task_state spawning.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] No waiting events found dispatching network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received unexpected event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd for instance with vm_state building and task_state spawning.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] No waiting events found dispatching network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received unexpected event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b for instance with vm_state building and task_state spawning.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] No waiting events found dispatching network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:44 user nova-compute[72810]: WARNING nova.compute.manager [req-8ddbb9ca-12d5-4311-a94d-4abe7dd2c451 req-15df53fb-0182-47c3-be02-d018bd02bb14 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received unexpected event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b for instance with vm_state building and task_state spawning.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828784.6062999, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Started (Lifecycle Event)
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-505361169',display_name='tempest-ServerRescueNegativeTestJSON-server-505361169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-505361169',id=5,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-f18xavb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:28Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=603fa513-0076-4a25-8d93-a6032d551afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:44 user nova-compute[72810]:   <uuid>603fa513-0076-4a25-8d93-a6032d551afd</uuid>
Jul 31 18:39:44 user nova-compute[72810]:   <name>instance-00000005</name>
Jul 31 18:39:44 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:44 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:44 user nova-compute[72810]:   <metadata>
Jul 31 18:39:44 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:44 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-505361169</nova:name>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:44</nova:creationTime>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:44 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:port uuid="35fdd52e-a504-49c3-aad2-a8ef4e018b97">
Jul 31 18:39:44 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:39:44 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:44 user nova-compute[72810]:   </metadata>
Jul 31 18:39:44 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:44 user nova-compute[72810]:     <system>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="serial">603fa513-0076-4a25-8d93-a6032d551afd</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="uuid">603fa513-0076-4a25-8d93-a6032d551afd</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:44 user nova-compute[72810]:     </system>
Jul 31 18:39:44 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:44 user nova-compute[72810]:   <os>
Jul 31 18:39:44 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:44 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:44 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:44 user nova-compute[72810]:   </os>
Jul 31 18:39:44 user nova-compute[72810]:   <features>
Jul 31 18:39:44 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:44 user nova-compute[72810]:     <apic/>
Jul 31 18:39:44 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:44 user nova-compute[72810]:   </features>
Jul 31 18:39:44 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:44 user nova-compute[72810]:   </clock>
Jul 31 18:39:44 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:44 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:44 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:44 user nova-compute[72810]:   </cpu>
Jul 31 18:39:44 user nova-compute[72810]:   <devices>
Jul 31 18:39:44 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:44 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:44 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </disk>
Jul 31 18:39:44 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:44 user nova-compute[72810]:       <mac address="fa:16:3e:49:ce:43"/>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="tap35fdd52e-a5"/>
Jul 31 18:39:44 user nova-compute[72810]:     </interface>
Jul 31 18:39:44 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:44 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/console.log" append="off"/>
Jul 31 18:39:44 user nova-compute[72810]:     </serial>
Jul 31 18:39:44 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:     <video>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </video>
Jul 31 18:39:44 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:44 user nova-compute[72810]:     </rng>
Jul 31 18:39:44 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:44 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:44 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:44 user nova-compute[72810]:   </devices>
Jul 31 18:39:44 user nova-compute[72810]: </domain>
Jul 31 18:39:44 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-505361169',display_name='tempest-ServerRescueNegativeTestJSON-server-505361169',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-505361169',id=5,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-f18xavb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:28Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=603fa513-0076-4a25-8d93-a6032d551afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG os_vif [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'pci_devices' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:44 user nova-compute[72810]:   <uuid>8dc56ab6-c880-4078-9bfb-4b2089655c9f</uuid>
Jul 31 18:39:44 user nova-compute[72810]:   <name>instance-00000006</name>
Jul 31 18:39:44 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:44 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:44 user nova-compute[72810]:   <metadata>
Jul 31 18:39:44 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:44 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherB-server-633726612</nova:name>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:44</nova:creationTime>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:44 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:user uuid="13def89025e84e98a4ed596c16e0d0ce">tempest-ServerActionsTestOtherB-275988675-project-member</nova:user>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:project uuid="1be7d23c4eb74c43a79711e7253b436c">tempest-ServerActionsTestOtherB-275988675</nova:project>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:port uuid="8f869796-d849-427e-91fe-d54efcdb4674">
Jul 31 18:39:44 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:39:44 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:44 user nova-compute[72810]:   </metadata>
Jul 31 18:39:44 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:44 user nova-compute[72810]:     <system>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="serial">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="uuid">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:44 user nova-compute[72810]:     </system>
Jul 31 18:39:44 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:44 user nova-compute[72810]:   <os>
Jul 31 18:39:44 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:44 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:44 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:44 user nova-compute[72810]:   </os>
Jul 31 18:39:44 user nova-compute[72810]:   <features>
Jul 31 18:39:44 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:44 user nova-compute[72810]:     <apic/>
Jul 31 18:39:44 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:44 user nova-compute[72810]:   </features>
Jul 31 18:39:44 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:44 user nova-compute[72810]:   </clock>
Jul 31 18:39:44 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:44 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:44 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:44 user nova-compute[72810]:   </cpu>
Jul 31 18:39:44 user nova-compute[72810]:   <devices>
Jul 31 18:39:44 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:44 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:44 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </disk>
Jul 31 18:39:44 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:44 user nova-compute[72810]:       <mac address="fa:16:3e:04:7a:fa"/>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="tap8f869796-d8"/>
Jul 31 18:39:44 user nova-compute[72810]:     </interface>
Jul 31 18:39:44 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:44 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/console.log" append="off"/>
Jul 31 18:39:44 user nova-compute[72810]:     </serial>
Jul 31 18:39:44 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:     <video>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </video>
Jul 31 18:39:44 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:44 user nova-compute[72810]:     </rng>
Jul 31 18:39:44 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:44 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:44 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:44 user nova-compute[72810]:   </devices>
Jul 31 18:39:44 user nova-compute[72810]: </domain>
Jul 31 18:39:44 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG os_vif [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:44 user nova-compute[72810]: INFO nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Took 19.41 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:44 user nova-compute[72810]:   <uuid>c7aebd74-38c4-4925-8723-9d88596169cb</uuid>
Jul 31 18:39:44 user nova-compute[72810]:   <name>instance-00000008</name>
Jul 31 18:39:44 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:44 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:44 user nova-compute[72810]:   <metadata>
Jul 31 18:39:44 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:44 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeTestJSON-server-2077908289</nova:name>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:44</nova:creationTime>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:44 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:user uuid="3b2bbbd7a792431688c8d575d2c71d21">tempest-AttachVolumeTestJSON-1714901238-project-member</nova:user>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:project uuid="15a633ca9965410aa6ce5b2b86a6f198">tempest-AttachVolumeTestJSON-1714901238</nova:project>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:44 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:         <nova:port uuid="e0013d9f-8ad7-4d9e-8874-6987d6db9c9c">
Jul 31 18:39:44 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:39:44 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:44 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:44 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:44 user nova-compute[72810]:   </metadata>
Jul 31 18:39:44 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:44 user nova-compute[72810]:     <system>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="serial">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="uuid">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:39:44 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:44 user nova-compute[72810]:     </system>
Jul 31 18:39:44 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:44 user nova-compute[72810]:   <os>
Jul 31 18:39:44 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:44 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:44 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:44 user nova-compute[72810]:   </os>
Jul 31 18:39:44 user nova-compute[72810]:   <features>
Jul 31 18:39:44 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:44 user nova-compute[72810]:     <apic/>
Jul 31 18:39:44 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:44 user nova-compute[72810]:   </features>
Jul 31 18:39:44 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:44 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:44 user nova-compute[72810]:   </clock>
Jul 31 18:39:44 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:44 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:44 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:44 user nova-compute[72810]:   </cpu>
Jul 31 18:39:44 user nova-compute[72810]:   <devices>
Jul 31 18:39:44 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:44 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:44 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </disk>
Jul 31 18:39:44 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:44 user nova-compute[72810]:       <mac address="fa:16:3e:ed:6c:7c"/>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:44 user nova-compute[72810]:       <target dev="tape0013d9f-8a"/>
Jul 31 18:39:44 user nova-compute[72810]:     </interface>
Jul 31 18:39:44 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:44 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/console.log" append="off"/>
Jul 31 18:39:44 user nova-compute[72810]:     </serial>
Jul 31 18:39:44 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:44 user nova-compute[72810]:     <video>
Jul 31 18:39:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:44 user nova-compute[72810]:     </video>
Jul 31 18:39:44 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:44 user nova-compute[72810]:     </rng>
Jul 31 18:39:44 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:44 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:44 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:44 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:44 user nova-compute[72810]:   </devices>
Jul 31 18:39:44 user nova-compute[72810]: </domain>
Jul 31 18:39:44 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG os_vif [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35fdd52e-a5, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35fdd52e-a5, col_values=(('external_ids', {'iface-id': '35fdd52e-a504-49c3-aad2-a8ef4e018b97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ce:43', 'vm-uuid': '603fa513-0076-4a25-8d93-a6032d551afd'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: INFO os_vif [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5')
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f869796-d8, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f869796-d8, col_values=(('external_ids', {'iface-id': '8f869796-d849-427e-91fe-d54efcdb4674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7a:fa', 'vm-uuid': '8dc56ab6-c880-4078-9bfb-4b2089655c9f'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0013d9f-8a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0013d9f-8a, col_values=(('external_ids', {'iface-id': 'e0013d9f-8ad7-4d9e-8874-6987d6db9c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:6c:7c', 'vm-uuid': 'c7aebd74-38c4-4925-8723-9d88596169cb'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:45 user nova-compute[72810]: INFO os_vif [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:45 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: INFO os_vif [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:39:45 user nova-compute[72810]: INFO nova.compute.manager [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Took 20.66 seconds to build instance.
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:49:ce:43, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4585db29-d351-41d6-b753-50a12a059acd tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.949s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828785.8165343, d138fb7b-7969-4099-8e54-dfd892738660 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:45 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Resumed (Lifecycle Event)
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No VIF found with MAC fa:16:3e:04:7a:fa, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No VIF found with MAC fa:16:3e:ed:6c:7c, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance spawned successfully.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Instance spawned successfully.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828785.8181522, d138fb7b-7969-4099-8e54-dfd892738660 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Started (Lifecycle Event)
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Instance spawned successfully.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance spawned successfully.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 5.011s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.485s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.claims [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Claim successful on node user
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.1933463, 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] VM Resumed (Lifecycle Event)
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Took 19.80 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Took 12.59 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Took 18.77 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Took 20.55 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.policy [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd457df295124730b399dbd1fbed9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8582394664644b7c51c435c4299ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.1960156, 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] VM Started (Lifecycle Event)
Jul 31 18:39:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:46 user nova-compute[72810]: INFO nova.compute.manager [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Took 20.81 seconds to build instance.
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Creating image(s)
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "/opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "/opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-60fe7289-0c00-4ed3-8570-b9aa5188e780 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.061s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Took 20.07 seconds to build instance.
Jul 31 18:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Took 13.83 seconds to build instance.
Jul 31 18:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b12bc382-23ca-4e9e-b171-60fbbe7b03a4 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.251s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.188s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.2804, 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] VM Resumed (Lifecycle Event)
Jul 31 18:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d51b435-4178-426b-85aa-876b2a2fcb74 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.058s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Took 22.59 seconds to build instance.
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.280738, 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] VM Started (Lifecycle Event)
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9b1226ed-1c4b-4328-aa9a-db5700c2164a tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.774s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.2807992, d164c447-f733-4779-ad93-1f6e9b4bb72c => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] VM Resumed (Lifecycle Event)
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.314s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk 1073741824" returned: 0 in 0.114s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.439s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828786.2899, d164c447-f733-4779-ad93-1f6e9b4bb72c => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] VM Started (Lifecycle Event)
Jul 31 18:39:47 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.556s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.348s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Cannot resize image /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.objects.instance [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'migration_context' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Successfully created port: d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.policy [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da57973acf5749bd9d64e4ff32aed6af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fac98a014eb243d4984474abf026c457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:39:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Creating image(s)
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "475876a82ee29236f652f1b5ae962531866f3cde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "475876a82ee29236f652f1b5ae962531866f3cde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.part --force-share --output=json" returned: 0 in 0.281s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.virt.images [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] dac327e2-dd30-42b3-ace2-9a98bc7bfbc3 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.part /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Successfully updated port: d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-changed-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Refreshing instance network info cache due to event network-changed-d7604c16-d497-4383-954b-102230c1cc54. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] Acquiring lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] Acquired lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG nova.network.neutron [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Refreshing network info cache for port d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.part /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.converted" returned: 0 in 0.495s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:50 user nova-compute[72810]: WARNING nova.compute.manager [req-5238267f-fa7e-4fb3-a4e9-2ded2dcf59d7 req-048a26fd-8598-4bec-91ee-b7871b73fad2 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state building and task_state spawning.
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde.converted --force-share --output=json" returned: 0 in 0.363s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "475876a82ee29236f652f1b5ae962531866f3cde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.934s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json" returned: 0 in 0.372s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "475876a82ee29236f652f1b5ae962531866f3cde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "475876a82ee29236f652f1b5ae962531866f3cde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json" returned: 0 in 0.311s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde,backing_fmt=raw /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2dd9f98-a667-4fd9-a0c5-42684bed187f req-b5ec76df-c787-4f2d-9c71-e7f824f1335c service nova] Releasing lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquired lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde,backing_fmt=raw /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk 1073741824" returned: 0 in 0.256s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "475876a82ee29236f652f1b5ae962531866f3cde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.575s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde --force-share --output=json" returned: 0 in 0.298s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Successfully created port: 5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Cannot resize image /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'migration_context' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Ensure instance console log exists: /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.compute.manager [req-afb23edc-f9a5-4708-a02e-1d1f860b1bcf req-3e6b030d-b2a8-48e5-9946-5ed8f4138972 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state building and task_state spawning.
Jul 31 18:39:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state building and task_state spawning.
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state building and task_state spawning.
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.compute.manager [req-0382f30f-7cbf-4e98-9f10-08a60f9b1ac2 req-f8cc7d46-2d23-4ba7-b0e5-8478e070f1a7 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state building and task_state spawning.
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating instance_info_cache with network_info: [{"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Releasing lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance network_info: |[{"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Start _get_guest_xml network_info=[{"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1424152566',display_name='tempest-VolumesAdminNegativeTest-server-1424152566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1424152566',id=9,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwGLdep6dy+KFrOrqskzd6fK6f4Y8AXwYesuWqtAzYadxDKYH+B5VFy/aTNPuFgtgPiH3XOcD8y4A0xX7kaueqVjmkFIeco2pC80q8niLXoZFEcyL3bAqYjZC43P54VeA==',key_name='tempest-keypair-68104375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-hh30yn07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd457df295124730b399dbd1fbed9d94',uuid=c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.objects.instance [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:53 user nova-compute[72810]:   <uuid>c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81</uuid>
Jul 31 18:39:53 user nova-compute[72810]:   <name>instance-00000009</name>
Jul 31 18:39:53 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:53 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:53 user nova-compute[72810]:   <metadata>
Jul 31 18:39:53 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:53 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1424152566</nova:name>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:52</nova:creationTime>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:53 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:53 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:user uuid="fd457df295124730b399dbd1fbed9d94">tempest-VolumesAdminNegativeTest-2135289877-project-member</nova:user>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:project uuid="21b8582394664644b7c51c435c4299ab">tempest-VolumesAdminNegativeTest-2135289877</nova:project>
Jul 31 18:39:53 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:39:53 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:53 user nova-compute[72810]:         <nova:port uuid="d7604c16-d497-4383-954b-102230c1cc54">
Jul 31 18:39:53 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 18:39:53 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:53 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:53 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:53 user nova-compute[72810]:   </metadata>
Jul 31 18:39:53 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:53 user nova-compute[72810]:     <system>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="serial">c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81</entry>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="uuid">c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81</entry>
Jul 31 18:39:53 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:53 user nova-compute[72810]:     </system>
Jul 31 18:39:53 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:53 user nova-compute[72810]:   <os>
Jul 31 18:39:53 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:53 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:53 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:53 user nova-compute[72810]:   </os>
Jul 31 18:39:53 user nova-compute[72810]:   <features>
Jul 31 18:39:53 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:53 user nova-compute[72810]:     <apic/>
Jul 31 18:39:53 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:53 user nova-compute[72810]:   </features>
Jul 31 18:39:53 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:53 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:53 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:53 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:53 user nova-compute[72810]:   </clock>
Jul 31 18:39:53 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:53 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:53 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:53 user nova-compute[72810]:   </cpu>
Jul 31 18:39:53 user nova-compute[72810]:   <devices>
Jul 31 18:39:53 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:53 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:53 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk"/>
Jul 31 18:39:53 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:39:53 user nova-compute[72810]:     </disk>
Jul 31 18:39:53 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:53 user nova-compute[72810]:       <mac address="fa:16:3e:62:6c:eb"/>
Jul 31 18:39:53 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:53 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:53 user nova-compute[72810]:       <target dev="tapd7604c16-d4"/>
Jul 31 18:39:53 user nova-compute[72810]:     </interface>
Jul 31 18:39:53 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:53 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/console.log" append="off"/>
Jul 31 18:39:53 user nova-compute[72810]:     </serial>
Jul 31 18:39:53 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:53 user nova-compute[72810]:     <video>
Jul 31 18:39:53 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:53 user nova-compute[72810]:     </video>
Jul 31 18:39:53 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:53 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:53 user nova-compute[72810]:     </rng>
Jul 31 18:39:53 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:53 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:53 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:53 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:53 user nova-compute[72810]:   </devices>
Jul 31 18:39:53 user nova-compute[72810]: </domain>
Jul 31 18:39:53 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1424152566',display_name='tempest-VolumesAdminNegativeTest-server-1424152566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1424152566',id=9,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwGLdep6dy+KFrOrqskzd6fK6f4Y8AXwYesuWqtAzYadxDKYH+B5VFy/aTNPuFgtgPiH3XOcD8y4A0xX7kaueqVjmkFIeco2pC80q8niLXoZFEcyL3bAqYjZC43P54VeA==',key_name='tempest-keypair-68104375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-hh30yn07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd457df295124730b399dbd1fbed9d94',uuid=c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG os_vif [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7604c16-d4, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd7604c16-d4, col_values=(('external_ids', {'iface-id': 'd7604c16-d497-4383-954b-102230c1cc54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:6c:eb', 'vm-uuid': 'c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:53 user nova-compute[72810]: INFO os_vif [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4')
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No VIF found with MAC fa:16:3e:62:6c:eb, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Successfully updated port: 5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquired lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-changed-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Refreshing instance network info cache due to event network-changed-5fab64db-6099-4a48-b754-35b49c1cc414. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] Acquiring lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:54 user nova-compute[72810]: WARNING nova.compute.manager [req-f3fa9d30-21a0-46d6-919a-4d5507b1c883 req-618f0f76-83c7-4860-8c5b-0d067aac2608 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state building and task_state spawning.
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updating instance_info_cache with network_info: [{"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Releasing lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Instance network_info: |[{"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] Acquired lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Refreshing network info cache for port 5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Start _get_guest_xml network_info=[{"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:39:37Z,direct_url=<?>,disk_format='qcow2',id=dac327e2-dd30-42b3-ace2-9a98bc7bfbc3,min_disk=0,min_ram=0,name='',owner='b56a289aaf3741e88d3c644d59ce1521',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:39:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'dac327e2-dd30-42b3-ace2-9a98bc7bfbc3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:39:54 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:54 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:39:37Z,direct_url=<?>,disk_format='qcow2',id=dac327e2-dd30-42b3-ace2-9a98bc7bfbc3,min_disk=0,min_ram=0,name='',owner='b56a289aaf3741e88d3c644d59ce1521',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:39:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1449754410',display_name='tempest-AttachSCSIVolumeTestJSON-server-1449754410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1449754410',id=10,image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtYm9cnUo0Biu5wctlZtcoGXsjPvu/G143HQ16yGTQW34MsY2xfbOx7hS9jKyMG7O2zfYQ1krgLXlHXQI5qVVGgbbvn/KpEcCujPAZxMMxUZe01HYMdE82o+cs2bFgGSA==',key_name='tempest-keypair-180920959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fac98a014eb243d4984474abf026c457',ramdisk_id='',reservation_id='r-ffv0dm08',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1840850624',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1840850624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da57973acf5749bd9d64e4ff32aed6af',uuid=7d49ce3e-82ef-4c35-a217-4213791073b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converting VIF {"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:39:54 user nova-compute[72810]:   <uuid>7d49ce3e-82ef-4c35-a217-4213791073b9</uuid>
Jul 31 18:39:54 user nova-compute[72810]:   <name>instance-0000000a</name>
Jul 31 18:39:54 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:39:54 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:39:54 user nova-compute[72810]:   <metadata>
Jul 31 18:39:54 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:39:54 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1449754410</nova:name>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:39:54</nova:creationTime>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:39:54 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:39:54 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:owner>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:user uuid="da57973acf5749bd9d64e4ff32aed6af">tempest-AttachSCSIVolumeTestJSON-1840850624-project-member</nova:user>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:project uuid="fac98a014eb243d4984474abf026c457">tempest-AttachSCSIVolumeTestJSON-1840850624</nova:project>
Jul 31 18:39:54 user nova-compute[72810]:       </nova:owner>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:root type="image" uuid="dac327e2-dd30-42b3-ace2-9a98bc7bfbc3"/>
Jul 31 18:39:54 user nova-compute[72810]:       <nova:ports>
Jul 31 18:39:54 user nova-compute[72810]:         <nova:port uuid="5fab64db-6099-4a48-b754-35b49c1cc414">
Jul 31 18:39:54 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:39:54 user nova-compute[72810]:         </nova:port>
Jul 31 18:39:54 user nova-compute[72810]:       </nova:ports>
Jul 31 18:39:54 user nova-compute[72810]:     </nova:instance>
Jul 31 18:39:54 user nova-compute[72810]:   </metadata>
Jul 31 18:39:54 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:39:54 user nova-compute[72810]:     <system>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="serial">7d49ce3e-82ef-4c35-a217-4213791073b9</entry>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="uuid">7d49ce3e-82ef-4c35-a217-4213791073b9</entry>
Jul 31 18:39:54 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:39:54 user nova-compute[72810]:     </system>
Jul 31 18:39:54 user nova-compute[72810]:   </sysinfo>
Jul 31 18:39:54 user nova-compute[72810]:   <os>
Jul 31 18:39:54 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:39:54 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:39:54 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:39:54 user nova-compute[72810]:   </os>
Jul 31 18:39:54 user nova-compute[72810]:   <features>
Jul 31 18:39:54 user nova-compute[72810]:     <acpi/>
Jul 31 18:39:54 user nova-compute[72810]:     <apic/>
Jul 31 18:39:54 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:39:54 user nova-compute[72810]:   </features>
Jul 31 18:39:54 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:39:54 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:39:54 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:39:54 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:39:54 user nova-compute[72810]:   </clock>
Jul 31 18:39:54 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:39:54 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:39:54 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:39:54 user nova-compute[72810]:   </cpu>
Jul 31 18:39:54 user nova-compute[72810]:   <devices>
Jul 31 18:39:54 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:39:54 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:39:54 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk"/>
Jul 31 18:39:54 user nova-compute[72810]:       <target dev="sda" bus="scsi"/>
Jul 31 18:39:54 user nova-compute[72810]:       <address type="drive" controller="0" unit="0"/>
Jul 31 18:39:54 user nova-compute[72810]:     </disk>
Jul 31 18:39:54 user nova-compute[72810]:     <disk type="file" device="cdrom">
Jul 31 18:39:54 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 18:39:54 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.config"/>
Jul 31 18:39:54 user nova-compute[72810]:       <target dev="sdb" bus="scsi"/>
Jul 31 18:39:54 user nova-compute[72810]:       <address type="drive" controller="0" unit="1"/>
Jul 31 18:39:54 user nova-compute[72810]:     </disk>
Jul 31 18:39:54 user nova-compute[72810]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 31 18:39:54 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:39:54 user nova-compute[72810]:       <mac address="fa:16:3e:2e:1b:c6"/>
Jul 31 18:39:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:54 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:39:54 user nova-compute[72810]:       <target dev="tap5fab64db-60"/>
Jul 31 18:39:54 user nova-compute[72810]:     </interface>
Jul 31 18:39:54 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:39:54 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/console.log" append="off"/>
Jul 31 18:39:54 user nova-compute[72810]:     </serial>
Jul 31 18:39:54 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:39:54 user nova-compute[72810]:     <video>
Jul 31 18:39:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:39:54 user nova-compute[72810]:     </video>
Jul 31 18:39:54 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:39:54 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:39:54 user nova-compute[72810]:     </rng>
Jul 31 18:39:54 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:39:54 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:39:54 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:39:54 user nova-compute[72810]:     </memballoon>
Jul 31 18:39:54 user nova-compute[72810]:   </devices>
Jul 31 18:39:54 user nova-compute[72810]: </domain>
Jul 31 18:39:54 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1449754410',display_name='tempest-AttachSCSIVolumeTestJSON-server-1449754410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1449754410',id=10,image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtYm9cnUo0Biu5wctlZtcoGXsjPvu/G143HQ16yGTQW34MsY2xfbOx7hS9jKyMG7O2zfYQ1krgLXlHXQI5qVVGgbbvn/KpEcCujPAZxMMxUZe01HYMdE82o+cs2bFgGSA==',key_name='tempest-keypair-180920959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fac98a014eb243d4984474abf026c457',ramdisk_id='',reservation_id='r-ffv0dm08',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1840850624',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1840850624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da57973acf5749bd9d64e4ff32aed6af',uuid=7d49ce3e-82ef-4c35-a217-4213791073b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converting VIF {"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG os_vif [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fab64db-60, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fab64db-60, col_values=(('external_ids', {'iface-id': '5fab64db-6099-4a48-b754-35b49c1cc414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:1b:c6', 'vm-uuid': '7d49ce3e-82ef-4c35-a217-4213791073b9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:54 user nova-compute[72810]: INFO os_vif [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60')
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No BDM found with device name sda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No VIF found with MAC fa:16:3e:2e:1b:c6, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Using config drive
Jul 31 18:39:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828795.6934183, c7aebd74-38c4-4925-8723-9d88596169cb => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Resumed (Lifecycle Event)
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance spawned successfully.
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updated VIF entry in instance network info cache for port 5fab64db-6099-4a48-b754-35b49c1cc414. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updating instance_info_cache with network_info: [{"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c8cdc535-0bbd-4b6a-bbcd-240cb934c135 req-e54cf362-c655-45df-8f97-919211565c2a service nova] Releasing lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Creating config drive at /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.config
Jul 31 18:39:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp28oncwkw {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:55 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828795.69355, c7aebd74-38c4-4925-8723-9d88596169cb => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Started (Lifecycle Event)
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] No waiting events found dispatching network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:56 user nova-compute[72810]: WARNING nova.compute.manager [req-59865c72-2768-4485-abcf-52ddebc984e2 req-47850330-9073-4772-9875-d6e071835edc service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received unexpected event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 for instance with vm_state building and task_state spawning.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp28oncwkw" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828796.2494087, 603fa513-0076-4a25-8d93-a6032d551afd => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] VM Resumed (Lifecycle Event)
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance spawned successfully.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Took 20.57 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance spawned successfully.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828796.2558136, 603fa513-0076-4a25-8d93-a6032d551afd => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] VM Started (Lifecycle Event)
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Took 21.58 seconds to build instance.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ac1fc26e-18f1-4936-b5d3-69ded0f0e556 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.682s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828796.281875, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Resumed (Lifecycle Event)
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Took 28.19 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Took 26.58 seconds to spawn the instance on the hypervisor.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828796.2853916, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:39:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Started (Lifecycle Event)
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:39:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:57 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:39:57 user nova-compute[72810]: INFO nova.compute.manager [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Took 28.33 seconds to build instance.
Jul 31 18:39:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-1f3107ad-4d10-4180-89c3-eaaccd1014a6 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.592s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:57 user nova-compute[72810]: INFO nova.compute.manager [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Took 29.65 seconds to build instance.
Jul 31 18:39:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-33d38807-437a-42d5-bf40-b9ae0d8963ac tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.787s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] No waiting events found dispatching network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:58 user nova-compute[72810]: WARNING nova.compute.manager [req-09547df7-7fe8-4bb4-9b45-34abd5b39e98 req-de017282-d180-4bfa-84ce-969a247316ab service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received unexpected event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 for instance with vm_state building and task_state spawning.
Jul 31 18:39:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:39:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:39:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:39:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:39:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:39:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] No waiting events found dispatching network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:39:59 user nova-compute[72810]: WARNING nova.compute.manager [req-3e72ded5-5df2-49ab-af66-04909ca36f28 req-d9e286f3-bbf8-441e-9614-3e1f84ba0b69 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received unexpected event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 for instance with vm_state building and task_state spawning.
Jul 31 18:39:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] No waiting events found dispatching network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:40:01 user nova-compute[72810]: WARNING nova.compute.manager [req-44cf79a2-8a98-4992-a9b8-9a665ed4f0bd req-115f6d89-a77d-4e5b-bedf-5faec57e521f service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received unexpected event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 for instance with vm_state building and task_state spawning.
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828802.1613667, c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] VM Resumed (Lifecycle Event)
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance spawned successfully.
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828802.165305, c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] VM Started (Lifecycle Event)
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Took 15.52 seconds to spawn the instance on the hypervisor.
Jul 31 18:40:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:02 user nova-compute[72810]: INFO nova.compute.manager [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Took 21.40 seconds to build instance.
Jul 31 18:40:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-785a10b0-8224-4010-bfea-38fa57941d3f tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.569s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828803.1373875, 7d49ce3e-82ef-4c35-a217-4213791073b9 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] VM Resumed (Lifecycle Event)
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Instance spawned successfully.
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828803.14949, 7d49ce3e-82ef-4c35-a217-4213791073b9 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] VM Started (Lifecycle Event)
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:03 user nova-compute[72810]: INFO nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Took 14.97 seconds to spawn the instance on the hypervisor.
Jul 31 18:40:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:04 user nova-compute[72810]: INFO nova.compute.manager [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Took 20.10 seconds to build instance.
Jul 31 18:40:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-be954559-cd9f-4271-a4d6-c886284239b7 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.250s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 18:40:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:40:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:40:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7493MB free_disk=25.809432983398438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7d49ce3e-82ef-4c35-a217-4213791073b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:40:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:40:13 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:40:13 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:40:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:40:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:40:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:40:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:40:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:40:43 user nova-compute[72810]: INFO nova.compute.claims [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Claim successful on node user
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 18:40:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:40:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.policy [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26d1d9f9b9f843beb3359f1d43b7b4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d5a317bf9243e48b85a0a0633f72d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:40:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Creating image(s)
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "/opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "/opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk 1073741824" returned: 0 in 0.052s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Cannot resize image /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'migration_context' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Ensure instance console log exists: /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Successfully created port: 6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:40:45 user nova-compute[72810]: INFO nova.compute.claims [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Claim successful on node user
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:40:45 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Successfully updated port: 6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquired lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-changed-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Refreshing instance network info cache due to event network-changed-6d0445ab-03f8-4ef5-9c98-970b6c0298fc. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] Acquiring lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:46 user nova-compute[72810]: INFO nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Booting with volume 0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f at /dev/vda
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.policy [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0cf4e9343bc43afa1f50f475c603a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b065437c578e499489592685bf8637b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:40:46 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpenlvygld/privsep.sock']
Jul 31 18:40:46 user sudo[84099]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpenlvygld/privsep.sock
Jul 31 18:40:46 user sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updating instance_info_cache with network_info: [{"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Releasing lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Instance network_info: |[{"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] Acquired lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Refreshing network info cache for port 6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Start _get_guest_xml network_info=[{"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:40:46 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:40:46 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273429083',display_name='tempest-VolumesSnapshotTestJSON-instance-1273429083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273429083',id=11,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ucE8YuUSXuO3YYvVHuIX5wLwMaa+pxt8KEaHW1BW7Tfr6OCndiqvJpw6k2CSt3VPp7sXqD/erkG/4J1mn9aEyWWuAUMe9Z5D+aSOyiQwDid3fLxlI1cm6z5Fd7ljtBw==',key_name='tempest-keypair-1843738402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-scl67aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=ba030dcb-c9f2-4a7a-b426-3a2c1772582f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'pci_devices' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:40:46 user nova-compute[72810]:   <uuid>ba030dcb-c9f2-4a7a-b426-3a2c1772582f</uuid>
Jul 31 18:40:46 user nova-compute[72810]:   <name>instance-0000000b</name>
Jul 31 18:40:46 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:40:46 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:40:46 user nova-compute[72810]:   <metadata>
Jul 31 18:40:46 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:40:46 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1273429083</nova:name>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:40:46</nova:creationTime>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:40:46 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:40:46 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:owner>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:user uuid="26d1d9f9b9f843beb3359f1d43b7b4e8">tempest-VolumesSnapshotTestJSON-1152708704-project-member</nova:user>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:project uuid="70d5a317bf9243e48b85a0a0633f72d8">tempest-VolumesSnapshotTestJSON-1152708704</nova:project>
Jul 31 18:40:46 user nova-compute[72810]:       </nova:owner>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:40:46 user nova-compute[72810]:       <nova:ports>
Jul 31 18:40:46 user nova-compute[72810]:         <nova:port uuid="6d0445ab-03f8-4ef5-9c98-970b6c0298fc">
Jul 31 18:40:46 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 18:40:46 user nova-compute[72810]:         </nova:port>
Jul 31 18:40:46 user nova-compute[72810]:       </nova:ports>
Jul 31 18:40:46 user nova-compute[72810]:     </nova:instance>
Jul 31 18:40:46 user nova-compute[72810]:   </metadata>
Jul 31 18:40:46 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:40:46 user nova-compute[72810]:     <system>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="serial">ba030dcb-c9f2-4a7a-b426-3a2c1772582f</entry>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="uuid">ba030dcb-c9f2-4a7a-b426-3a2c1772582f</entry>
Jul 31 18:40:46 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:40:46 user nova-compute[72810]:     </system>
Jul 31 18:40:46 user nova-compute[72810]:   </sysinfo>
Jul 31 18:40:46 user nova-compute[72810]:   <os>
Jul 31 18:40:46 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:40:46 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:40:46 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:40:46 user nova-compute[72810]:   </os>
Jul 31 18:40:46 user nova-compute[72810]:   <features>
Jul 31 18:40:46 user nova-compute[72810]:     <acpi/>
Jul 31 18:40:46 user nova-compute[72810]:     <apic/>
Jul 31 18:40:46 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:40:46 user nova-compute[72810]:   </features>
Jul 31 18:40:46 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:40:46 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:40:46 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:40:46 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:40:46 user nova-compute[72810]:   </clock>
Jul 31 18:40:46 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:40:46 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:40:46 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:40:46 user nova-compute[72810]:   </cpu>
Jul 31 18:40:46 user nova-compute[72810]:   <devices>
Jul 31 18:40:46 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:40:46 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:40:46 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk"/>
Jul 31 18:40:46 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:40:46 user nova-compute[72810]:     </disk>
Jul 31 18:40:46 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:40:46 user nova-compute[72810]:       <mac address="fa:16:3e:19:0b:b8"/>
Jul 31 18:40:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:40:46 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:40:46 user nova-compute[72810]:       <target dev="tap6d0445ab-03"/>
Jul 31 18:40:46 user nova-compute[72810]:     </interface>
Jul 31 18:40:46 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:40:46 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/console.log" append="off"/>
Jul 31 18:40:46 user nova-compute[72810]:     </serial>
Jul 31 18:40:46 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:40:46 user nova-compute[72810]:     <video>
Jul 31 18:40:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:40:46 user nova-compute[72810]:     </video>
Jul 31 18:40:46 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:40:46 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:40:46 user nova-compute[72810]:     </rng>
Jul 31 18:40:46 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:40:46 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:40:46 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:40:46 user nova-compute[72810]:     </memballoon>
Jul 31 18:40:46 user nova-compute[72810]:   </devices>
Jul 31 18:40:46 user nova-compute[72810]: </domain>
Jul 31 18:40:46 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273429083',display_name='tempest-VolumesSnapshotTestJSON-instance-1273429083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273429083',id=11,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ucE8YuUSXuO3YYvVHuIX5wLwMaa+pxt8KEaHW1BW7Tfr6OCndiqvJpw6k2CSt3VPp7sXqD/erkG/4J1mn9aEyWWuAUMe9Z5D+aSOyiQwDid3fLxlI1cm6z5Fd7ljtBw==',key_name='tempest-keypair-1843738402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-scl67aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=ba030dcb-c9f2-4a7a-b426-3a2c1772582f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG os_vif [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d0445ab-03, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d0445ab-03, col_values=(('external_ids', {'iface-id': '6d0445ab-03f8-4ef5-9c98-970b6c0298fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0b:b8', 'vm-uuid': 'ba030dcb-c9f2-4a7a-b426-3a2c1772582f'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:46 user nova-compute[72810]: INFO os_vif [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03')
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No VIF found with MAC fa:16:3e:19:0b:b8, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully created port: 77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updated VIF entry in instance network info cache for port 6d0445ab-03f8-4ef5-9c98-970b6c0298fc. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updating instance_info_cache with network_info: [{"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-99a51f80-de57-4a7b-a1fc-91f3db2f3603 req-19c67418-f206-4027-9159-f33867c0d431 service nova] Releasing lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:47 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully created port: be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:47 user sudo[84099]: pam_unix(sudo:session): session closed for user root
Jul 31 18:40:47 user nova-compute[72810]: INFO oslo.privsep.daemon [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Spawned new privsep daemon via rootwrap
Jul 31 18:40:47 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 18:40:47 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 18:40:47 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 31 18:40:47 user nova-compute[72810]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84119
Jul 31 18:40:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[01466111-2e1a-41c2-8c05-7c68895aff8c]: (2,) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:47 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully created port: 3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea59f75-910f-4061-b742-53344de889bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.nvmeof [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff940f-a490-4189-8072-4708d0b6cc62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92cc81-3e3e-4141-aeed-6f902ea87ee4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c494d1b9-27f2-4619-aafe-e3ceb60d5a28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:40:48 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d3b99-2fc2-47f5-bc15-e8c72eae3847]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== get_connector_properties: return (2042ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating existing volume attachment record: eceec8c6-2dbf-4e47-a081-f039ac7a6ac2 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] No waiting events found dispatching network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:40:48 user nova-compute[72810]: WARNING nova.compute.manager [req-77a3b780-29d0-415a-b838-3784dc81d946 req-d23224ab-b8dd-4dd6-b2d0-89d3a4d32e65 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received unexpected event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc for instance with vm_state building and task_state spawning.
Jul 31 18:40:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully created port: 9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully created port: 647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828850.1351295, ba030dcb-c9f2-4a7a-b426-3a2c1772582f => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] VM Resumed (Lifecycle Event)
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Instance spawned successfully.
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828850.1366446, ba030dcb-c9f2-4a7a-b426-3a2c1772582f => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] VM Started (Lifecycle Event)
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Took 7.16 seconds to build instance.
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6128fabd-61dd-4e9e-be20-aed4026612dc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.266s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-77feced5-eb37-409a-897e-38396bf2277d. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] No waiting events found dispatching network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:40:50 user nova-compute[72810]: WARNING nova.compute.manager [req-f6e9dd74-30f7-42f4-b42f-a045cae7ea57 req-de90adc3-771b-4e6f-bde3-26e3444b04f9 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received unexpected event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc for instance with vm_state active and task_state None.
Jul 31 18:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc02ff6e-ee21-4c01-b449-a3717c1d1e3f req-df480657-8ae1-40f0-b2f6-c13db2e56323 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-4dccc112-7920-4086-80db-e4ee7e4bb13f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-8a735b41-7bd0-424d-85b9-61082d370709. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-61b009b7-a6e9-40e3-b928-d271e933c7a2 req-9875b387-6ef5-40fe-b4d5-f51b33a1d016 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-be2c9303-04a0-4602-8bda-4f60dd9a51cc. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-3efd8eca-0296-4572-878b-427bcace84fc. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00334bd1-e86c-440e-b245-37c0ab7737a2 req-33f115e8-efd4-4939-9428-605d24bedef0 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Successfully updated port: 647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:40:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:40:55 user nova-compute[72810]: INFO nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Booting with volume 9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 at /dev/vdb
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0a3f71-c1f7-447f-8dc1-35667c924836]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eca8cd5-a450-4d4a-a442-25a17cf6a2fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed7a63d-eb34-48d6-95e4-280078d51126]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c1665-b4bf-4f14-aef3-63e715c20f27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:40:56 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db0dae-f2e7-46f8-942a-a5a151df4068]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating existing volume attachment record: c08c4c90-3193-495d-b8b9-bbd846a4aeb1 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-9553687d-24d3-4bd6-af0c-84abc5d9c35e. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.network.neutron [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance network_info: |[{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updated VIF entry in instance network info cache for port 9553687d-24d3-4bd6-af0c-84abc5d9c35e. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-647e4232-7729-420b-a7a3-6e17cb3da3e7. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:40:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:40:59 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updated VIF entry in instance network info cache for port 647e4232-7729-420b-a7a3-6e17cb3da3e7. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:40:59 user nova-compute[72810]: DEBUG nova.network.neutron [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:40:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2b958224-1c58-4fd2-a66d-11c8324f9d56 req-ccfb6d36-3c12-439d-887a-bef2916db284 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:41:04 user nova-compute[72810]: INFO nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Booting with volume 771ea2a1-f7c6-43da-8658-9ac5d5f19052 at /dev/vdc
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ce017-4ae2-456d-8d42-0d08a6f4f23d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1afa27-25c0-4997-a3fc-92167ef4d7f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[774e1bee-29a6-497c-80b3-b1b0c94511bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0345c-5179-4cc8-ba74-73aab6e71acc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:04 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14f4884-29cc-40c6-82d1-b8e63694909a]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG os_brick.utils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:04 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating existing volume attachment record: d61d4705-e12c-407b-95f4-6fcc9407fa9b {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:07 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=6559MB free_disk=25.58983612060547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:41:12 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Creating image(s)
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Ensure instance console log exists: /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Start _get_guest_xml network_info=[{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDsLIQvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9', 'attached_at': '', 'detached_at': '', 'volume_id': '0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f', 'serial': '0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f'}, 'attachment_id': 'eceec8c6-2dbf-4e47-a081-f039ac7a6ac2', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZBuQtvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9', 'attached_at': '', 'detached_at': '', 'volume_id': '9b41f188-1e6c-4a83-adf3-f64c3dbd9e20', 'serial': '9b41f188-1e6c-4a83-adf3-f64c3dbd9e20'}, 'attachment_id': 'c08c4c90-3193-495d-b8b9-bbd846a4aeb1', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsizngq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9', 'attached_at': '', 'detached_at': '', 'volume_id': '771ea2a1-f7c6-43da-8658-9ac5d5f19052', 'serial': '771ea2a1-f7c6-43da-8658-9ac5d5f19052'}, 'attachment_id': 'd61d4705-e12c-407b-95f4-6fcc9407fa9b', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7d49ce3e-82ef-4c35-a217-4213791073b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:41:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:12 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connector [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Factory for ISCSI on None {{(pid=72810) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDsLIQvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:12 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:12 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:12 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d1f7bc-8745-4027-a283-c00536c1ce98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:12 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57aaa30-0917-4d1e-90b0-4ebb5305b322]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f] added
Jul 31 18:41:12 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea22102-dcc9-4269-980a-c3c9fbfa15ae]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a2814c-ed4c-40b1-8168-70d0742486b5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zDsLIQvd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zDsLIQvd" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fde19a-ccd3-489e-b3cd-426836d4c5a2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zDsLIQvd'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab22c5da-06cf-496a-a2c5-8a7326067e14]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf82961e-c4d2-47a3-a254-9e08d0ec67c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 18:41:12 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 18:41:12 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:12 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 18:41:12 user nova-compute[72810]: 
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --login" returned: 0 in 0.142s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be25dfb-a899-465d-96f4-1905e06d8e0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260]
Jul 31 18:41:12 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:12 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe2703e-4786-4415-b9e1-c65882ea79c3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4691b7-82ee-4635-a6dd-0662eb5cf3c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:12 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:12 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8dd73-0498-49cb-895a-0059ef8ee708]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDsLIQvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:41:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26463663034363033', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463663034363033', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZBuQtvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:13 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:13 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:13 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd67d9-29c7-437e-9961-e3c7a35224a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:13 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f8acd9-1ad6-473d-8e4d-b29afe69713c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20] added
Jul 31 18:41:13 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f56ce-2257-41da-a7bc-37e7bffed23e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[94212d5e-49e0-42aa-82ba-72e46226707b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZBuQtvj {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZBuQtvj" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b448f83e-80f5-4d69-bdd8-fe59a16efcb3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yZBuQtvj'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18899a-8d36-4198-9a75-bfb37a30c8fa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[08121084-bcaf-4b10-b4f9-a83b73ff32d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:13 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:13 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ce298-4dcb-4b90-a597-865fb405081e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260]
Jul 31 18:41:14 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:14 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682e533-d04a-4b14-a6a7-dc6715242cbf]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de1e4f3-8bde-480f-aa27-080ffc34f680]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:14 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:14 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:14 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:14 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6aba77-a447-4877-b258-d797fca69cab]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZBuQtvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating instance_info_cache with network_info: [{"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26662373837316631', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662373837316631', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsizngq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:15 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:15 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:15 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-changed-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing instance network info cache due to event network-changed-54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing network info cache for port 54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127564f-890a-43ae-bbf0-2fe9b1c870f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:15 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb51406-0691-4ba9-918d-e9ff3bc38fc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052] added
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d752a6-2ccb-4e26-9a24-888c26f56972]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1fa3f-2c5d-4fa2-9b3c-c7074d644af6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsizngq {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJsizngq" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa5365-e448-4063-81b2-a18499dfa3c0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJsizngq'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b26a7-7fdd-4efa-a9cc-6975438f232e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524976d-4f49-4c10-9b04-355a86efd1ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee683f-85c6-469f-ba9f-c946a9149c88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260]
Jul 31 18:41:15 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafc48a5-ee9c-4702-b7b6-e4fd1b20ea2d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e68a365-1da8-4875-a4be-a23d1915adfd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f3d118-60ef-4447-b1d8-f6cecea95511]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsizngq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updated VIF entry in instance network info cache for port 54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41300952-11db-4b8d-8ddc-0a3c0dd5ede9 req-36fb303d-411c-4afe-b6bd-2bd11c730130 service nova] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23139333237653039', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139333237653039', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lazy-loading 'pci_devices' on Instance uuid 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:41:16 user nova-compute[72810]:   <uuid>84cfb6eb-d33c-4f07-8856-0c49901f0ec9</uuid>
Jul 31 18:41:16 user nova-compute[72810]:   <name>instance-0000000c</name>
Jul 31 18:41:16 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:41:16 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:41:16 user nova-compute[72810]:   <metadata>
Jul 31 18:41:16 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:41:16 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:name>tempest-device-tagging-server-727134348</nova:name>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:41:12</nova:creationTime>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:41:16 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:41:16 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:owner>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:user uuid="a0cf4e9343bc43afa1f50f475c603a19">tempest-TaggedBootDevicesTest-638038997-project-member</nova:user>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:project uuid="b065437c578e499489592685bf8637b5">tempest-TaggedBootDevicesTest-638038997</nova:project>
Jul 31 18:41:16 user nova-compute[72810]:       </nova:owner>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:41:16 user nova-compute[72810]:       <nova:ports>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="77feced5-eb37-409a-897e-38396bf2277d">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="4dccc112-7920-4086-80db-e4ee7e4bb13f">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="8a735b41-7bd0-424d-85b9-61082d370709">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="be2c9303-04a0-4602-8bda-4f60dd9a51cc">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="3efd8eca-0296-4572-878b-427bcace84fc">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="9553687d-24d3-4bd6-af0c-84abc5d9c35e">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:         <nova:port uuid="647e4232-7729-420b-a7a3-6e17cb3da3e7">
Jul 31 18:41:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 18:41:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:16 user nova-compute[72810]:       </nova:ports>
Jul 31 18:41:16 user nova-compute[72810]:     </nova:instance>
Jul 31 18:41:16 user nova-compute[72810]:   </metadata>
Jul 31 18:41:16 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:41:16 user nova-compute[72810]:     <system>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="serial">84cfb6eb-d33c-4f07-8856-0c49901f0ec9</entry>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="uuid">84cfb6eb-d33c-4f07-8856-0c49901f0ec9</entry>
Jul 31 18:41:16 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:41:16 user nova-compute[72810]:     </system>
Jul 31 18:41:16 user nova-compute[72810]:   </sysinfo>
Jul 31 18:41:16 user nova-compute[72810]:   <os>
Jul 31 18:41:16 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:41:16 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:41:16 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:41:16 user nova-compute[72810]:   </os>
Jul 31 18:41:16 user nova-compute[72810]:   <features>
Jul 31 18:41:16 user nova-compute[72810]:     <acpi/>
Jul 31 18:41:16 user nova-compute[72810]:     <apic/>
Jul 31 18:41:16 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:41:16 user nova-compute[72810]:   </features>
Jul 31 18:41:16 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:41:16 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:41:16 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:41:16 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:41:16 user nova-compute[72810]:   </clock>
Jul 31 18:41:16 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:41:16 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:41:16 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:41:16 user nova-compute[72810]:   </cpu>
Jul 31 18:41:16 user nova-compute[72810]:   <devices>
Jul 31 18:41:16 user nova-compute[72810]:     <disk type="file" device="cdrom">
Jul 31 18:41:16 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 18:41:16 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/disk.config"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="hda" bus="ide"/>
Jul 31 18:41:16 user nova-compute[72810]:     </disk>
Jul 31 18:41:16 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:41:16 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:16 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <serial>0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f</serial>
Jul 31 18:41:16 user nova-compute[72810]:     </disk>
Jul 31 18:41:16 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:41:16 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:16 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <serial>9b41f188-1e6c-4a83-adf3-f64c3dbd9e20</serial>
Jul 31 18:41:16 user nova-compute[72810]:     </disk>
Jul 31 18:41:16 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:41:16 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:16 user nova-compute[72810]:       <source dev="/dev/sdd"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="vdc" bus="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <serial>771ea2a1-f7c6-43da-8658-9ac5d5f19052</serial>
Jul 31 18:41:16 user nova-compute[72810]:     </disk>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:67:93:d4"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap77feced5-eb"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:73:2a:b8"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap4dccc112-79"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:2e:a1:25"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap8a735b41-7b"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:50:a4:0a"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tapbe2c9303-04"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:76:9d:41"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap3efd8eca-02"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:02:60:02"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap9553687d-24"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:16 user nova-compute[72810]:       <mac address="fa:16:3e:a2:13:3d"/>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:16 user nova-compute[72810]:       <target dev="tap647e4232-77"/>
Jul 31 18:41:16 user nova-compute[72810]:     </interface>
Jul 31 18:41:16 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:41:16 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/console.log" append="off"/>
Jul 31 18:41:16 user nova-compute[72810]:     </serial>
Jul 31 18:41:16 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:41:16 user nova-compute[72810]:     <video>
Jul 31 18:41:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:16 user nova-compute[72810]:     </video>
Jul 31 18:41:16 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:41:16 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:41:16 user nova-compute[72810]:     </rng>
Jul 31 18:41:16 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:41:16 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:41:16 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:41:16 user nova-compute[72810]:     </memballoon>
Jul 31 18:41:16 user nova-compute[72810]:   </devices>
Jul 31 18:41:16 user nova-compute[72810]: </domain>
Jul 31 18:41:16 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77feced5-eb, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77feced5-eb, col_values=(('external_ids', {'iface-id': '77feced5-eb37-409a-897e-38396bf2277d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:93:d4', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dccc112-79, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dccc112-79, col_values=(('external_ids', {'iface-id': '4dccc112-7920-4086-80db-e4ee7e4bb13f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:2a:b8', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a735b41-7b, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a735b41-7b, col_values=(('external_ids', {'iface-id': '8a735b41-7bd0-424d-85b9-61082d370709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:a1:25', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe2c9303-04, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe2c9303-04, col_values=(('external_ids', {'iface-id': 'be2c9303-04a0-4602-8bda-4f60dd9a51cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:a4:0a', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3efd8eca-02, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3efd8eca-02, col_values=(('external_ids', {'iface-id': '3efd8eca-0296-4572-878b-427bcace84fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:9d:41', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9553687d-24, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9553687d-24, col_values=(('external_ids', {'iface-id': '9553687d-24d3-4bd6-af0c-84abc5d9c35e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:60:02', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24')
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647e4232-77, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap647e4232-77, col_values=(('external_ids', {'iface-id': '647e4232-7729-420b-a7a3-6e17cb3da3e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:13:3d', 'vm-uuid': '84cfb6eb-d33c-4f07-8856-0c49901f0ec9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:17 user nova-compute[72810]: INFO os_vif [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77')
Jul 31 18:41:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] No BDM found with device name hda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] No VIF found with MAC fa:16:3e:67:93:d4, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] No VIF found with MAC fa:16:3e:76:9d:41, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Using config drive
Jul 31 18:41:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Creating config drive at /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/disk.config
Jul 31 18:41:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmyjzzfyq {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmyjzzfyq" returned: 0 in 0.061s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lazy-loading 'flavor' on Instance uuid 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:18 user nova-compute[72810]: INFO nova.compute.manager [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Rescuing
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.network.neutron [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:18 user nova-compute[72810]: INFO nova.compute.manager [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Attaching volume 9cdda271-4aa0-4944-acac-92ad477edb04 to /dev/vdb
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.utils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a650b7-f8f1-4e88-b14f-8f22217f81b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb8159-3892-4611-8e4e-ee6e782a7941]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ebe169-a1d5-4933-928c-e2f7caa14305]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0fd4f-3330-4409-90c0-8430efb914c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:18 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9744a04f-9734-47ef-b848-2ca71d94b8c3]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG os_brick.utils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating existing volume attachment record: 4374b40c-6134-4b08-9294-1936d52adb3b {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-changed-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Refreshing instance network info cache due to event network-changed-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] Acquiring lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] Acquired lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.network.neutron [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Refreshing network info cache for port 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:18 user nova-compute[72810]: DEBUG nova.network.neutron [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance destroyed successfully.
Jul 31 18:41:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Attempting rescue
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:41:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Creating image(s)
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'trusted_certs' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.compute.manager [req-516db65a-e343-4205-9db9-94d8b3c9bd79 req-6674f433-ad85-4f37-b173-9273a10cbdf5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f for instance with vm_state building and task_state spawning.
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue" returned: 0 in 0.057s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start _get_guest_xml network_info=[{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:49:ce:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'numa_topology' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'vcpu_model' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-505361169',display_name='tempest-ServerRescueNegativeTestJSON-server-505361169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-505361169',id=5,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-f18xavb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:57Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=603fa513-0076-4a25-8d93-a6032d551afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:49:ce:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:49:ce:43"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.compute.manager [req-96992421-3ed1-4633-910a-99ac7c0bff6c req-5239dea1-beb7-4952-ac5d-8ea7b2a735ef service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d for instance with vm_state building and task_state spawning.
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:41:20 user nova-compute[72810]:   <uuid>603fa513-0076-4a25-8d93-a6032d551afd</uuid>
Jul 31 18:41:20 user nova-compute[72810]:   <name>instance-00000005</name>
Jul 31 18:41:20 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:41:20 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:41:20 user nova-compute[72810]:   <metadata>
Jul 31 18:41:20 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:41:20 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-505361169</nova:name>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:41:20</nova:creationTime>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:41:20 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:41:20 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:owner>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:41:20 user nova-compute[72810]:       </nova:owner>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:41:20 user nova-compute[72810]:       <nova:ports>
Jul 31 18:41:20 user nova-compute[72810]:         <nova:port uuid="35fdd52e-a504-49c3-aad2-a8ef4e018b97">
Jul 31 18:41:20 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:41:20 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:20 user nova-compute[72810]:       </nova:ports>
Jul 31 18:41:20 user nova-compute[72810]:     </nova:instance>
Jul 31 18:41:20 user nova-compute[72810]:   </metadata>
Jul 31 18:41:20 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:41:20 user nova-compute[72810]:     <system>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="serial">603fa513-0076-4a25-8d93-a6032d551afd</entry>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="uuid">603fa513-0076-4a25-8d93-a6032d551afd</entry>
Jul 31 18:41:20 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:41:20 user nova-compute[72810]:     </system>
Jul 31 18:41:20 user nova-compute[72810]:   </sysinfo>
Jul 31 18:41:20 user nova-compute[72810]:   <os>
Jul 31 18:41:20 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:41:20 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:41:20 user nova-compute[72810]:   </os>
Jul 31 18:41:20 user nova-compute[72810]:   <features>
Jul 31 18:41:20 user nova-compute[72810]:     <acpi/>
Jul 31 18:41:20 user nova-compute[72810]:     <apic/>
Jul 31 18:41:20 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:41:20 user nova-compute[72810]:   </features>
Jul 31 18:41:20 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:41:20 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:41:20 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:41:20 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:41:20 user nova-compute[72810]:   </clock>
Jul 31 18:41:20 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:41:20 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:41:20 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:41:20 user nova-compute[72810]:   </cpu>
Jul 31 18:41:20 user nova-compute[72810]:   <devices>
Jul 31 18:41:20 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:41:20 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:41:20 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue"/>
Jul 31 18:41:20 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:41:20 user nova-compute[72810]:     </disk>
Jul 31 18:41:20 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:41:20 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:41:20 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk"/>
Jul 31 18:41:20 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:41:20 user nova-compute[72810]:     </disk>
Jul 31 18:41:20 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:20 user nova-compute[72810]:       <mac address="fa:16:3e:49:ce:43"/>
Jul 31 18:41:20 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:20 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:20 user nova-compute[72810]:       <target dev="tap35fdd52e-a5"/>
Jul 31 18:41:20 user nova-compute[72810]:     </interface>
Jul 31 18:41:20 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:41:20 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/console.log" append="off"/>
Jul 31 18:41:20 user nova-compute[72810]:     </serial>
Jul 31 18:41:20 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:41:20 user nova-compute[72810]:     <video>
Jul 31 18:41:20 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:20 user nova-compute[72810]:     </video>
Jul 31 18:41:20 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:41:20 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:41:20 user nova-compute[72810]:     </rng>
Jul 31 18:41:20 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:41:20 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:41:20 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:41:20 user nova-compute[72810]:     </memballoon>
Jul 31 18:41:20 user nova-compute[72810]:   </devices>
Jul 31 18:41:20 user nova-compute[72810]: </domain>
Jul 31 18:41:20 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance destroyed successfully.
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:49:ce:43, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state active and task_state rescuing.
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:20 user nova-compute[72810]: WARNING nova.compute.manager [req-eb9d7abe-dedd-4e45-ba9b-37adc462d4ac req-af8c4f9e-7eec-4f41-9e49-6e8a5fefa754 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state active and task_state rescuing.
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updated VIF entry in instance network info cache for port 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35561332-b9a4-45e6-b0e1-7fc957e656a8 req-2df74230-d7c9-4719-b57b-656fc39dd47c service nova] Releasing lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-70a2bb2c-455c-4bc0-8224-af3595b20311 req-886070b8-5825-4cc2-ae69-4fbbef56d012 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:22 user nova-compute[72810]: WARNING nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d for instance with vm_state building and task_state spawning.
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-changed-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Refreshing instance network info cache due to event network-changed-8f869796-d849-427e-91fe-d54efcdb4674. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:22 user nova-compute[72810]: DEBUG nova.network.neutron [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Refreshing network info cache for port 8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc for instance with vm_state building and task_state spawning.
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING nova.compute.manager [req-aaf31c95-5ff5-4b70-bb57-36f40d2004bb req-8d526095-05fd-4acf-aad3-08d8e7fe4472 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc for instance with vm_state building and task_state spawning.
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.objects.instance [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.network.neutron [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updated VIF entry in instance network info cache for port 8f869796-d849-427e-91fe-d54efcdb4674. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.network.neutron [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 for instance with vm_state building and task_state spawning.
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 for instance with vm_state building and task_state spawning.
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING nova.compute.manager [req-bc585e77-80d7-483f-a5e0-ce69d8bd951e req-b77c3c48-3c2f-4375-80b8-bb5cff4afad4 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 for instance with vm_state building and task_state spawning.
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:23 user nova-compute[72810]: INFO nova.compute.manager [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Attaching volume 62474fcc-2fa5-41ff-8d28-2076b8bde451 to /dev/vdb
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.utils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef89f47-a3b4-4d41-9429-f4b854e32f52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c500f3e5-1fa1-4f62-933c-c6d2dbea730f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2028cd-c07a-4681-a000-091c70f764c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce081f9-93e3-413f-ac4c-ca008ee42f0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:23 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[55096705-35db-44ac-a714-a86b8f22e999]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG os_brick.utils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating existing volume attachment record: a9e3561d-ef95-4d56-a83e-eeda6a2768c5 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:24 user nova-compute[72810]: WARNING nova.compute.manager [req-42b908a6-0a06-45e8-a423-352c106d74ce req-824b5bbc-bf6c-473d-a9da-dd2d531aeca2 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 for instance with vm_state building and task_state spawning.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:25 user nova-compute[72810]: WARNING nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state active and task_state rescuing.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:25 user nova-compute[72810]: WARNING nova.compute.manager [req-d35bd902-6657-42ca-8668-a9bd3730b1d9 req-46c808fd-e9c5-4589-b31b-6cef191e235e service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state active and task_state rescuing.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-changed-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Refreshing instance network info cache due to event network-changed-a1476142-9922-4e4a-8d94-356504c1bc7b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] Acquiring lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] Acquired lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Refreshing network info cache for port a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828885.785486, 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] VM Resumed (Lifecycle Event)
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance spawned successfully.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828885.7872612, 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] VM Started (Lifecycle Event)
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-78645a74-910c-4d25-862b-0129b119580c tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for 603fa513-0076-4a25-8d93-a6032d551afd due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828885.898202, 603fa513-0076-4a25-8d93-a6032d551afd => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] VM Resumed (Lifecycle Event)
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:26 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828885.9017336, 603fa513-0076-4a25-8d93-a6032d551afd => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:26 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] VM Started (Lifecycle Event)
Jul 31 18:41:26 user nova-compute[72810]: INFO nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Took 14.06 seconds to spawn the instance on the hypervisor.
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:26 user nova-compute[72810]: INFO nova.compute.manager [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Took 41.09 seconds to build instance.
Jul 31 18:41:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-659ff9d3-a74c-427b-8a0c-88b2918d97fe tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.197s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updated VIF entry in instance network info cache for port a1476142-9922-4e4a-8d94-356504c1bc7b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updating instance_info_cache with network_info: [{"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc44b044-af23-4256-b522-f72a8134324d req-9b600a14-1978-481b-a4da-ba5871812b9b service nova] Releasing lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-changed-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Refreshing instance network info cache due to event network-changed-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Refreshing network info cache for port e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updated VIF entry in instance network info cache for port e0013d9f-8ad7-4d9e-8874-6987d6db9c9c. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c4782b7-7caa-4796-a04b-31372d9a871c req-fbb0d580-8f0b-4615-9ff6-5da41edb4441 service nova] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeOJgoTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:27 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:27 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:27 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cefc8d-8a1f-4a12-846c-73d852a5960f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:27 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8376f6de-90ee-4474-b757-0860a7b7f3d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04] added
Jul 31 18:41:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f5218-0dd7-44aa-829c-a7a95904c693]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b6747-c230-423f-bacb-0aaabd0d978b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeOJgoTn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeOJgoTn" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[993fd69b-eeea-4621-85e9-9c16971ee735]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeOJgoTn'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f846a74-9073-46c1-9ea4-5206288f0331]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7bafa0-3a3c-422e-9618-5b8c1fc085bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b916c43-83da-44dd-a8fa-5a71e2a13020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260]
Jul 31 18:41:28 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a739f2a2-8825-47ca-9ba7-87b142e49782]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b2dda8-0c55-491d-919a-f63a7028ff95]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)
Jul 31 18:41:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ca3bd2-e7bc-4d57-99b3-47d83695b0f9]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeOJgoTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23535323135306532', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535323135306532', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lazy-loading 'flavor' on Instance uuid 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:41:29 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:29 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:41:29 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:41:29 user nova-compute[72810]:   <serial>9cdda271-4aa0-4944-acac-92ad477edb04</serial>
Jul 31 18:41:29 user nova-compute[72810]: </disk>
Jul 31 18:41:29 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] No VIF found with MAC fa:16:3e:da:0a:19, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0d947d04-ccfd-4939-be16-40cdd5d40b67 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.774s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:30 user nova-compute[72810]: INFO nova.compute.manager [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Terminating instance
Jul 31 18:41:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-unplugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] No waiting events found dispatching network-vif-unplugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-8f170709-7bb5-4496-b09e-82676ca1aa69 req-3e7e4afa-45e2-4b62-8e3b-0a2d15083ade service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-unplugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:41:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Instance destroyed successfully.
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.objects.instance [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lazy-loading 'resources' on Instance uuid 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1506770794',display_name='tempest-DeleteServersTestJSON-server-1506770794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1506770794',id=2,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ceac677c760547ef93b8d0ab9da05981',ramdisk_id='',reservation_id='r-uufnxwaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-827250694',owner_user_name='tempest-DeleteServersTestJSON-827250694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:39:47Z,user_data=None,user_id='783d7b552b7e4af3a80c428ecc806685',uuid=632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converting VIF {"id": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "address": "fa:16:3e:da:0a:19", "network": {"id": "10195451-c2b8-4efd-91ce-151deef9e7fc", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-979696587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ceac677c760547ef93b8d0ab9da05981", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbefbef71-58", "ovs_interfaceid": "befbef71-58cd-40ae-b0c7-4b1c7265ab1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_vif [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbefbef71-58, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:31 user nova-compute[72810]: INFO os_vif [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:0a:19,bridge_name='br-int',has_traffic_filtering=True,id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c,network=Network(10195451-c2b8-4efd-91ce-151deef9e7fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbefbef71-58')
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeOJgoTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:31 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe038f9d-d77f-4990-842d-61fd536dd43f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8912fe-3906-4558-bc96-39d81d153d8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 (non-flash)
Jul 31 18:41:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f40de170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[40996172-9472-4ecb-b585-db3cd4ee5ebc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a9d293-bf4d-4359-ada4-0ca2ef07ab1b]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d2d5d-a92b-4e3e-b4b3-0e6078124d6c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2760a13-8968-48aa-8d9c-2e793522a979]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f339a20-8d7a-46ab-b2e3-314caf330084]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d6553-b8bb-4bcd-9c12-d848a5d6d030]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260]
Jul 31 18:41:31 user nova-compute[72810]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cdda271-4aa0-4944-acac-92ad477edb04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8a8161-521a-4d6d-87c8-7cf164fbb847]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] <== disconnect_volume: return (352ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:41:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Deleting instance files /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11_del
Jul 31 18:41:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Deletion of /opt/stack/data/nova/instances/632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11_del complete
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72810) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 31 18:41:31 user nova-compute[72810]: INFO nova.virt.libvirt.host [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] UEFI support detected
Jul 31 18:41:31 user nova-compute[72810]: INFO nova.compute.manager [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 31 18:41:31 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:41:31 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Acquiring lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] No waiting events found dispatching network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:32 user nova-compute[72810]: WARNING nova.compute.manager [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received unexpected event network-vif-plugged-befbef71-58cd-40ae-b0c7-4b1c7265ab1c for instance with vm_state active and task_state deleting.
Jul 31 18:41:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-changed-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Refreshing instance network info cache due to event network-changed-d7604c16-d497-4383-954b-102230c1cc54. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Acquiring lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Acquired lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Refreshing network info cache for port d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:33 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Took 1.17 seconds to deallocate network for instance.
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-d48e21d5-5eeb-46dc-9a0d-9aad863ca1f1 req-67f454b7-aa02-4f02-b0b6-d6f93d85ac4f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Received event network-vif-deleted-befbef71-58cd-40ae-b0c7-4b1c7265ab1c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:33 user nova-compute[72810]: INFO nova.compute.manager [req-d48e21d5-5eeb-46dc-9a0d-9aad863ca1f1 req-67f454b7-aa02-4f02-b0b6-d6f93d85ac4f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Neutron deleted interface befbef71-58cd-40ae-b0c7-4b1c7265ab1c; detaching it from the instance and deleting it from the info cache
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-d48e21d5-5eeb-46dc-9a0d-9aad863ca1f1 req-67f454b7-aa02-4f02-b0b6-d6f93d85ac4f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-d48e21d5-5eeb-46dc-9a0d-9aad863ca1f1 req-67f454b7-aa02-4f02-b0b6-d6f93d85ac4f service nova] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Detach interface failed, port_id=befbef71-58cd-40ae-b0c7-4b1c7265ab1c, reason: Instance 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updated VIF entry in instance network info cache for port d7604c16-d497-4383-954b-102230c1cc54. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating instance_info_cache with network_info: [{"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35bb4560-51eb-418d-896e-cc5c84fcd88a req-684b0d4c-d43f-48b0-87be-505b65b8382f service nova] Releasing lock "refresh_cache-c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:33 user nova-compute[72810]: INFO nova.compute.manager [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Took 0.93 seconds to detach 1 volumes for instance.
Jul 31 18:41:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:34 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:41:34 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:41:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:34 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Deleted allocations for instance 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11
Jul 31 18:41:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-93b4abad-1465-44e4-a425-79c6e9ca12b1 tempest-DeleteServersTestJSON-827250694 tempest-DeleteServersTestJSON-827250694-project-member] Lock "632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.381s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-changed-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Refreshing instance network info cache due to event network-changed-5fab64db-6099-4a48-b754-35b49c1cc414. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] Acquiring lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] Acquired lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Refreshing network info cache for port 5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:35 user nova-compute[72810]: INFO nova.compute.manager [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Attaching volume 83f24d4b-26c4-4a56-8ffd-700412d64596 to /dev/vdb
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.utils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2805b189-1664-4002-9e41-98acc30ddfcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51bdcce-2c61-437b-9e96-29085f7d27d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bebea11-4b8b-4b00-8abc-ce5f3ddc76ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[165415f3-1397-4504-ac9f-12ffbcfc7f39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:36 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95624d-d868-4791-9ef5-d91810221f74]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG os_brick.utils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating existing volume attachment record: 256256d7-6a05-462c-b07b-46cdd244ede9 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updated VIF entry in instance network info cache for port 5fab64db-6099-4a48-b754-35b49c1cc414. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updating instance_info_cache with network_info: [{"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e10ae4eb-5002-48f0-b837-5f6b546d547a req-64e747a0-2df8-4473-84c4-7265f7b70c26 service nova] Releasing lock "refresh_cache-7d49ce3e-82ef-4c35-a217-4213791073b9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:41:37 user nova-compute[72810]: INFO nova.compute.claims [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Claim successful on node user
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:41:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:41:37 user nova-compute[72810]: DEBUG nova.policy [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b274199e036644afba90b84bd12b0f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb070b24ed34fb6b3f310d3fae39942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:41:37 user nova-compute[72810]: INFO nova.virt.block_device [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Booting with volume ad023e56-151e-454f-bf0c-853c0fdc0601 at /dev/vda
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.utils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c583e517-e075-4976-a174-a8f4b030c9c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68fffc-882c-47ed-a769-7e4a381cccfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8218697-1c5b-4db9-a835-9ec16d173fae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52999521-5a2f-4e74-b2b7-7b0e11e36d7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:38 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c080727-e76d-4dd2-8243-8cd1b91ed461]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG os_brick.utils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating existing volume attachment record: 6045af50-63bd-4bb8-a151-45b3c4118dbb {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Successfully created port: df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Successfully updated port: df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquired lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-changed-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Refreshing instance network info cache due to event network-changed-df39a498-a56b-4dba-94c7-0faccbc50443. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] Acquiring lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating instance_info_cache with network_info: [{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Releasing lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance network_info: |[{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] Acquired lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Refreshing network info cache for port df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updated VIF entry in instance network info cache for port df39a498-a56b-4dba-94c7-0faccbc50443. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating instance_info_cache with network_info: [{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3017db69-dc06-4429-870f-67c6eaa2e1a2 req-c1beb91c-46b4-471f-a5c6-c5842a93dc00 service nova] Releasing lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:44 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:44 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:44 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf950d-3931-4329-9852-fa9e0e4e1e13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:45 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[96359113-011c-4012-b03b-afe98c158e02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596] added
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b7d187-f737-4da4-ba4f-4a931dfc67ae]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8bab1d-1715-4108-8195-7d1d8f948054]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcJvLwKI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcJvLwKI" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed50034-52c9-4a42-9d3f-14cdcf475300]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcJvLwKI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd98a0-7001-45d2-8252-73a6de3ecb74]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862eaf4-5212-404e-8ab8-6908bf75a5ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d93c6-b1fa-4891-aa05-48dd4d4208e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]
Jul 31 18:41:45 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a4989a-aa68-435a-b4a2-76270637a243]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4336abd6-09ff-4134-990a-0472c64ec952]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f552090-383e-4a18-950a-fc9fd82363c1]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG nova.objects.instance [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'flavor' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbHQcov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:45 user nova-compute[72810]: INFO nova.compute.manager [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Attaching volume 93e3a1c3-8e35-498b-8911-8ae108e27bd5 to /dev/vdb
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.utils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[babb1b03-c798-46d3-ad1d-a0027556951d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b5a49-5f6d-4654-a9f9-8c407cf30802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a8121-e257-4cfc-b1ed-1f96763b27c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8929572a-649e-4672-944e-13bc0604f610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:45 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61686ba-80fb-4d56-9f6d-7c69cdfbc150]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating existing volume attachment record: 026c7c37-920e-43cc-83e8-5fd373a6a393 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23861333337336463', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861333337336463', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.604s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:46 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:46 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'flavor' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690828891.3600664, 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:46 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] VM Stopped (Lifecycle Event)
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a0854-6947-4c03-9f8b-4215959eceb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:46 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4fe0dc38-b27b-43a4-95e7-734dd4fb1bae None None] [instance: 632a9f0f-e0b3-4ba8-bc97-4d4b53db9f11] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:41:46 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:46 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:41:46 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:41:46 user nova-compute[72810]:   <serial>83f24d4b-26c4-4a56-8ffd-700412d64596</serial>
Jul 31 18:41:46 user nova-compute[72810]: </disk>
Jul 31 18:41:46 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6369a5-41c1-4478-8a2e-305d0287aaba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451] added
Jul 31 18:41:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4031b4f4-3a68-4bb1-9959-9e095e163a10]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3ddfe-d2b5-4792-8b90-33573d1b8b65]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKbHQcov {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKbHQcov" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255cda5-a16d-49ad-945f-1112044e182c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKbHQcov'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185cfc1-2bd7-4653-a8b1-d0c9e7b718f0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4532c85-13d5-468c-8d6e-9b9a5a6e5b70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:46 user nova-compute[72810]: INFO nova.compute.manager [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Attaching volume 93fb3f2b-0c77-44f1-b1ab-adea51229f70 to /dev/sdc
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[76647812-fb6d-40f4-bdc8-5c94868193ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45d29c-e2eb-40ce-9e3e-5d2c4cb515ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d32a10d-15b3-4af0-8dd5-5b83deb5bd55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe3433-541f-441a-9655-2d76574c3a56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:41:46 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:41:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca82ae9-9321-46a5-9d41-34f61da37f37]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:46 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updating existing volume attachment record: 4ef380cf-c6e9-4bc6-adef-6cfdfb55c8d7 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No VIF found with MAC fa:16:3e:ed:6c:7c, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0bbe3fc3-7c58-43c6-9efc-d6a42a7163c8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.498s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:41:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Creating image(s)
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Ensure instance console log exists: /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start _get_guest_xml network_info=[{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d690479-e8ce-427c-8008-daaf4ed124b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad023e56-151e-454f-bf0c-853c0fdc0601', 'serial': 'ad023e56-151e-454f-bf0c-853c0fdc0601'}, 'attachment_id': '6045af50-63bd-4bb8-a151-45b3c4118dbb', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --login" returned: 0 in 1.096s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fdc69b-8543-49d3-9e3b-148b0f10a512]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260]
Jul 31 18:41:47 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:47 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:47 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c167a-2710-4c3b-815d-5c0c24519561]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9a57d-475c-4640-a3b2-7715eb3fca98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:47 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.396s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d30332f-546d-4525-bfa6-756a40f35919]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbHQcov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72810) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:48 user nova-compute[72810]: WARNING nova.compute.manager [req-d3b2ea84-fe7c-4c81-9ba2-e6d30fc1e8f2 req-7ec1982e-e88c-411d-860a-b65a0976f8a5 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state active and task_state powering-off.
Jul 31 18:41:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance destroyed successfully.
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a96538a9-fb9e-41a0-a176-3a3f65833fcd tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.948s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.441s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '23137313532643066', 'path': '/dev/sdf'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137313532643066', 'path': '/dev/sdf'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.094s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:48 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.objects.instance [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d8fa82-da02-4e43-8a0b-e1fbf05c4f65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:48 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:41:48 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:48 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:41:48 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:41:48 user nova-compute[72810]:   <serial>62474fcc-2fa5-41ff-8d28-2076b8bde451</serial>
Jul 31 18:41:48 user nova-compute[72810]: </disk>
Jul 31 18:41:48 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2572a5a-aa92-4d20-9b1c-4862a4507120]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601] added
Jul 31 18:41:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9246cd-5330-4bf3-8cef-acbb5b6ac85f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e586a48a-026e-4776-aaf3-4b7a4f630a08]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKiZksLh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKiZksLh" returned: 0 in 0.037s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199a362-03af-4006-8ac2-4c410d45d3cd]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKiZksLh'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0846b7-3cf6-4fed-a378-d9e79ccf4670]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5dc7ca-941c-4b60-ab5a-9500ebc2084d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[452638bb-5af0-435c-84eb-74c952ad0b88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]
Jul 31 18:41:49 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:49 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5983e84-19db-4345-a012-13924e5ecc4b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[92303045-52e1-4f75-a04f-f1cae6e5e117]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:49 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d711c73-3970-421b-b374-ddda289081e8]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:01:76:d6, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23a28a8b-f337-40df-8502-9d5aba7fa434 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.336s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== connect_volume: return (2516ms) {'type': 'block', 'scsi_wwn': '26533323830306538', 'path': '/dev/sdg'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533323830306538', 'path': '/dev/sdg'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-40748779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:41:50 user nova-compute[72810]:   <uuid>1d690479-e8ce-427c-8008-daaf4ed124b1</uuid>
Jul 31 18:41:50 user nova-compute[72810]:   <name>instance-0000000d</name>
Jul 31 18:41:50 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:41:50 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:41:50 user nova-compute[72810]:   <metadata>
Jul 31 18:41:50 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:41:50 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:41:50 user nova-compute[72810]:       <nova:name>tempest-ServerActionsV293TestJSON-server-40748779</nova:name>
Jul 31 18:41:50 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:41:47</nova:creationTime>
Jul 31 18:41:50 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:41:50 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:41:50 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:41:50 user nova-compute[72810]:       <nova:owner>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:user uuid="b274199e036644afba90b84bd12b0f5b">tempest-ServerActionsV293TestJSON-373314597-project-member</nova:user>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:project uuid="1cb070b24ed34fb6b3f310d3fae39942">tempest-ServerActionsV293TestJSON-373314597</nova:project>
Jul 31 18:41:50 user nova-compute[72810]:       </nova:owner>
Jul 31 18:41:50 user nova-compute[72810]:       <nova:ports>
Jul 31 18:41:50 user nova-compute[72810]:         <nova:port uuid="df39a498-a56b-4dba-94c7-0faccbc50443">
Jul 31 18:41:50 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 18:41:50 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:50 user nova-compute[72810]:       </nova:ports>
Jul 31 18:41:50 user nova-compute[72810]:     </nova:instance>
Jul 31 18:41:50 user nova-compute[72810]:   </metadata>
Jul 31 18:41:50 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:41:50 user nova-compute[72810]:     <system>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="serial">1d690479-e8ce-427c-8008-daaf4ed124b1</entry>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="uuid">1d690479-e8ce-427c-8008-daaf4ed124b1</entry>
Jul 31 18:41:50 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:41:50 user nova-compute[72810]:     </system>
Jul 31 18:41:50 user nova-compute[72810]:   </sysinfo>
Jul 31 18:41:50 user nova-compute[72810]:   <os>
Jul 31 18:41:50 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:41:50 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:41:50 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:41:50 user nova-compute[72810]:   </os>
Jul 31 18:41:50 user nova-compute[72810]:   <features>
Jul 31 18:41:50 user nova-compute[72810]:     <acpi/>
Jul 31 18:41:50 user nova-compute[72810]:     <apic/>
Jul 31 18:41:50 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:41:50 user nova-compute[72810]:   </features>
Jul 31 18:41:50 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:41:50 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:41:50 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:41:50 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:41:50 user nova-compute[72810]:   </clock>
Jul 31 18:41:50 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:41:50 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:41:50 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:41:50 user nova-compute[72810]:   </cpu>
Jul 31 18:41:50 user nova-compute[72810]:   <devices>
Jul 31 18:41:50 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:41:50 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:50 user nova-compute[72810]:       <source dev="/dev/sdg"/>
Jul 31 18:41:50 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:41:50 user nova-compute[72810]:       <serial>ad023e56-151e-454f-bf0c-853c0fdc0601</serial>
Jul 31 18:41:50 user nova-compute[72810]:     </disk>
Jul 31 18:41:50 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:50 user nova-compute[72810]:       <mac address="fa:16:3e:7a:4a:9f"/>
Jul 31 18:41:50 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:50 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:50 user nova-compute[72810]:       <target dev="tapdf39a498-a5"/>
Jul 31 18:41:50 user nova-compute[72810]:     </interface>
Jul 31 18:41:50 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:41:50 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1/console.log" append="off"/>
Jul 31 18:41:50 user nova-compute[72810]:     </serial>
Jul 31 18:41:50 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:41:50 user nova-compute[72810]:     <video>
Jul 31 18:41:50 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:50 user nova-compute[72810]:     </video>
Jul 31 18:41:50 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:41:50 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:41:50 user nova-compute[72810]:     </rng>
Jul 31 18:41:50 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:41:50 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:41:50 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:41:50 user nova-compute[72810]:     </memballoon>
Jul 31 18:41:50 user nova-compute[72810]:   </devices>
Jul 31 18:41:50 user nova-compute[72810]: </domain>
Jul 31 18:41:50 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-40748779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG os_vif [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:50 user nova-compute[72810]: WARNING nova.compute.manager [req-03d0809f-dea0-43b4-ae24-706f5c03f11e req-665d6a3f-f604-49f9-a108-37234c5b05f4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state None.
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf39a498-a5, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf39a498-a5, col_values=(('external_ids', {'iface-id': 'df39a498-a56b-4dba-94c7-0faccbc50443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:4a:9f', 'vm-uuid': '1d690479-e8ce-427c-8008-daaf4ed124b1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:50 user nova-compute[72810]: INFO os_vif [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5')
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No VIF found with MAC fa:16:3e:7a:4a:9f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:52 user nova-compute[72810]: WARNING nova.compute.manager [req-f741d152-da0e-450e-a786-cb5a8f25e0d1 req-ed405117-41af-4c45-abca-bc28460fe544 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state building and task_state spawning.
Jul 31 18:41:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:41:52 user nova-compute[72810]: INFO nova.compute.claims [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Claim successful on node user
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.policy [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84386ba984b649c69a4a1110fe7954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ba7112dc8b41f8aad49ea1ce030afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Creating image(s)
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk 1073741824" returned: 0 in 0.048s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828913.8319669, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Resumed (Lifecycle Event)
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance spawned successfully.
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828913.8325362, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Started (Lifecycle Event)
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:41:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:53 user nova-compute[72810]: INFO nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Took 6.35 seconds to spawn the instance on the hypervisor.
Jul 31 18:41:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Successfully created port: 5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:54 user nova-compute[72810]: INFO nova.compute.manager [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Took 16.88 seconds to build instance.
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'migration_context' on Instance uuid 0ad2d315-6afe-4d01-98da-07d5c08548f7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:54 user nova-compute[72810]: WARNING nova.compute.manager [req-6883c8cb-754e-4997-8995-1bad0f8bf388 req-a5542ed9-030f-48ff-a573-2015d8f0f4ca service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state None.
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3072ea95-af07-40ae-9bf1-150df3f90e48 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.037s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Successfully updated port: 5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquired lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:41:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updating instance_info_cache with network_info: [{"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Releasing lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Instance network_info: |[{"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Start _get_guest_xml network_info=[{"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888846141',display_name='tempest-AttachVolumeNegativeTest-server-1888846141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888846141',id=14,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLq1hvNwWm7CwCKe/PtzoqIxXzfhkkafoZo0sNA3Ukti6RuYCZnsdDk8mgxC9SN1MpAU1lZOyBnZOti6m7zI6LpN5l/aq6p8TtdAIPxKAArHtKL1JsDTo1nOljlVCkJkg==',key_name='tempest-keypair-290784274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-sv0efcoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=0ad2d315-6afe-4d01-98da-07d5c08548f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad2d315-6afe-4d01-98da-07d5c08548f7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:41:55 user nova-compute[72810]:   <uuid>0ad2d315-6afe-4d01-98da-07d5c08548f7</uuid>
Jul 31 18:41:55 user nova-compute[72810]:   <name>instance-0000000e</name>
Jul 31 18:41:55 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:41:55 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:41:55 user nova-compute[72810]:   <metadata>
Jul 31 18:41:55 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:41:55 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1888846141</nova:name>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:41:55</nova:creationTime>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:41:55 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:41:55 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:owner>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:user uuid="84386ba984b649c69a4a1110fe7954dc">tempest-AttachVolumeNegativeTest-1544720465-project-member</nova:user>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:project uuid="d4ba7112dc8b41f8aad49ea1ce030afb">tempest-AttachVolumeNegativeTest-1544720465</nova:project>
Jul 31 18:41:55 user nova-compute[72810]:       </nova:owner>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:41:55 user nova-compute[72810]:       <nova:ports>
Jul 31 18:41:55 user nova-compute[72810]:         <nova:port uuid="5732244a-409f-49ec-af65-480aa2a14459">
Jul 31 18:41:55 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 18:41:55 user nova-compute[72810]:         </nova:port>
Jul 31 18:41:55 user nova-compute[72810]:       </nova:ports>
Jul 31 18:41:55 user nova-compute[72810]:     </nova:instance>
Jul 31 18:41:55 user nova-compute[72810]:   </metadata>
Jul 31 18:41:55 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:41:55 user nova-compute[72810]:     <system>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="serial">0ad2d315-6afe-4d01-98da-07d5c08548f7</entry>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="uuid">0ad2d315-6afe-4d01-98da-07d5c08548f7</entry>
Jul 31 18:41:55 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:41:55 user nova-compute[72810]:     </system>
Jul 31 18:41:55 user nova-compute[72810]:   </sysinfo>
Jul 31 18:41:55 user nova-compute[72810]:   <os>
Jul 31 18:41:55 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:41:55 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:41:55 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:41:55 user nova-compute[72810]:   </os>
Jul 31 18:41:55 user nova-compute[72810]:   <features>
Jul 31 18:41:55 user nova-compute[72810]:     <acpi/>
Jul 31 18:41:55 user nova-compute[72810]:     <apic/>
Jul 31 18:41:55 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:41:55 user nova-compute[72810]:   </features>
Jul 31 18:41:55 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:41:55 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:41:55 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:41:55 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:41:55 user nova-compute[72810]:   </clock>
Jul 31 18:41:55 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:41:55 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:41:55 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:41:55 user nova-compute[72810]:   </cpu>
Jul 31 18:41:55 user nova-compute[72810]:   <devices>
Jul 31 18:41:55 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:41:55 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:41:55 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk"/>
Jul 31 18:41:55 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:41:55 user nova-compute[72810]:     </disk>
Jul 31 18:41:55 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:41:55 user nova-compute[72810]:       <mac address="fa:16:3e:76:b9:b1"/>
Jul 31 18:41:55 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:55 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:41:55 user nova-compute[72810]:       <target dev="tap5732244a-40"/>
Jul 31 18:41:55 user nova-compute[72810]:     </interface>
Jul 31 18:41:55 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:41:55 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/console.log" append="off"/>
Jul 31 18:41:55 user nova-compute[72810]:     </serial>
Jul 31 18:41:55 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:41:55 user nova-compute[72810]:     <video>
Jul 31 18:41:55 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:41:55 user nova-compute[72810]:     </video>
Jul 31 18:41:55 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:41:55 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:41:55 user nova-compute[72810]:     </rng>
Jul 31 18:41:55 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:41:55 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:41:55 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:41:55 user nova-compute[72810]:     </memballoon>
Jul 31 18:41:55 user nova-compute[72810]:   </devices>
Jul 31 18:41:55 user nova-compute[72810]: </domain>
Jul 31 18:41:55 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888846141',display_name='tempest-AttachVolumeNegativeTest-server-1888846141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888846141',id=14,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLq1hvNwWm7CwCKe/PtzoqIxXzfhkkafoZo0sNA3Ukti6RuYCZnsdDk8mgxC9SN1MpAU1lZOyBnZOti6m7zI6LpN5l/aq6p8TtdAIPxKAArHtKL1JsDTo1nOljlVCkJkg==',key_name='tempest-keypair-290784274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-sv0efcoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:41:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=0ad2d315-6afe-4d01-98da-07d5c08548f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_vif [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5732244a-40, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5732244a-40, col_values=(('external_ids', {'iface-id': '5732244a-409f-49ec-af65-480aa2a14459', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:b9:b1', 'vm-uuid': '0ad2d315-6afe-4d01-98da-07d5c08548f7'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:55 user nova-compute[72810]: INFO os_vif [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40')
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:76:b9:b1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnMuRjsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:55 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:55 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:55 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:41:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b737f4-84b5-4d3d-82d6-b21980146b08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:41:55 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[03489b72-acba-4238-b0c3-2f40227d91f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70] added
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cfaf6e-6214-410e-bb89-d2a386dee51c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5537d0-5535-4e78-8ab5-63fdac06784d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnMuRjsl {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WnMuRjsl" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2286da88-b97d-4320-b65a-cfe2158f4834]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WnMuRjsl'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0982a25-5294-4ac0-8287-6e19869cf738]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385b599-9319-411f-97ef-a78e69433b8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-changed-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Refreshing instance network info cache due to event network-changed-5732244a-409f-49ec-af65-480aa2a14459. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] Acquiring lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] Acquired lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Refreshing network info cache for port 5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef50a02-0ea2-4a65-905c-9ccc8beffe97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260]
Jul 31 18:41:56 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca8b301-171d-4c74-93db-8156fbaf50fc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f1d922-58e7-40f1-ae9c-59a6384e1e08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)
Jul 31 18:41:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c906c-51ee-45a9-a2de-0a1befb4f0ba]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnMuRjsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updated VIF entry in instance network info cache for port 5732244a-409f-49ec-af65-480aa2a14459. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updating instance_info_cache with network_info: [{"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa28f45d-90ef-4d9c-9bab-20200fa96e8d req-03983e03-0ab3-402a-bb87-4184739ba2da service nova] Releasing lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23865616139643661', 'path': '/dev/sdh'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865616139643661', 'path': '/dev/sdh'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] No waiting events found dispatching network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:57 user nova-compute[72810]: WARNING nova.compute.manager [req-88075245-c7f2-488c-81a9-40701925ef13 req-4cabd8e2-5959-4e8b-a875-2531dd3d3345 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received unexpected event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 for instance with vm_state building and task_state spawning.
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'flavor' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:41:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:57 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:41:57 user nova-compute[72810]:   <target dev="sdc" bus="scsi"/>
Jul 31 18:41:57 user nova-compute[72810]:   <serial>93fb3f2b-0c77-44f1-b1ab-adea51229f70</serial>
Jul 31 18:41:57 user nova-compute[72810]:   <address type="drive" controller="0" unit="2"/>
Jul 31 18:41:57 user nova-compute[72810]: </disk>
Jul 31 18:41:57 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No BDM found with device name sda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:41:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] No VIF found with MAC fa:16:3e:2e:1b:c6, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:41:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a722401c-4c5d-4425-b226-dd72093b65f8 tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.570s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Detaching volume 93fb3f2b-0c77-44f1-b1ab-adea51229f70
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.virt.block_device [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Attempting to driver detach volume 93fb3f2b-0c77-44f1-b1ab-adea51229f70 from mountpoint /dev/sdc
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Attempting to detach device sdc from instance 7d49ce3e-82ef-4c35-a217-4213791073b9 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:41:59 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:59 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:41:59 user nova-compute[72810]:   <target dev="sdc" bus="scsi"/>
Jul 31 18:41:59 user nova-compute[72810]:   <serial>93fb3f2b-0c77-44f1-b1ab-adea51229f70</serial>
Jul 31 18:41:59 user nova-compute[72810]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 18:41:59 user nova-compute[72810]: </disk>
Jul 31 18:41:59 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Successfully detached device sdc from instance 7d49ce3e-82ef-4c35-a217-4213791073b9 from the persistent domain config.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7d49ce3e-82ef-4c35-a217-4213791073b9 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:41:59 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:41:59 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:41:59 user nova-compute[72810]:   <target dev="sdc" bus="scsi"/>
Jul 31 18:41:59 user nova-compute[72810]:   <serial>93fb3f2b-0c77-44f1-b1ab-adea51229f70</serial>
Jul 31 18:41:59 user nova-compute[72810]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 18:41:59 user nova-compute[72810]: </disk>
Jul 31 18:41:59 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] No waiting events found dispatching network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:41:59 user nova-compute[72810]: WARNING nova.compute.manager [req-67e12dd4-ab76-4f3e-9576-aa3915dab9cc req-3ae18382-2da0-46f3-aa73-6816fe184239 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received unexpected event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 for instance with vm_state building and task_state spawning.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828919.4185462, 0ad2d315-6afe-4d01-98da-07d5c08548f7 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] VM Resumed (Lifecycle Event)
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Instance spawned successfully.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828919.4205954, 0ad2d315-6afe-4d01-98da-07d5c08548f7 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] VM Started (Lifecycle Event)
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Took 6.18 seconds to spawn the instance on the hypervisor.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690828919.624335, 7d49ce3e-82ef-4c35-a217-4213791073b9 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Successfully detached device sdc from instance 7d49ce3e-82ef-4c35-a217-4213791073b9 from the live domain config.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WnMuRjsl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:41:59 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a559f4e-128e-4a6a-b8c3-7924c4361220]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c435db-2317-4342-8fb3-ffcda59f294b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 (non-flash)
Jul 31 18:41:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68fa0216c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70'): ({'sdh'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Removing single pathed devices sdh {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:41:59 user nova-compute[72810]: INFO nova.compute.manager [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Took 7.07 seconds to build instance.
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bd09db6d-85db-4cec-b9e0-3ad6a7a4553e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.172s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5f3e7-6b48-430c-8ecf-0096792befb1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e202b-0976-4a0c-9e81-a4ad23033b50]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Flushing IO for device /dev/sdh {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394b0ed-0c3e-4010-99ff-8556b0fa85d6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7268c363-dd30-4de8-a4b9-26e2f7af83f9]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d3aa22-edb3-4050-be41-18c28697b1f4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b6bee-8a3f-4b0c-9372-0a074853bd4d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260]
Jul 31 18:41:59 user nova-compute[72810]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70, portal: 172.16.0.220,3260] successful.
Jul 31 18:41:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:41:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93fb3f2b-0c77-44f1-b1ab-adea51229f70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a8d5f-cb46-4f1a-926b-66639a816cba]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] <== disconnect_volume: return (377ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG nova.objects.instance [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'flavor' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-96e3eecf-1b9f-4095-a00f-b3aee1c27e7a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.904s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:01 user nova-compute[72810]: INFO nova.compute.manager [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Terminating instance
Jul 31 18:42:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-unplugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] No waiting events found dispatching network-vif-unplugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-0b48e227-f17a-43cf-be73-c7036cca96a0 req-69e412a1-a411-4c90-ae71-d4265ef99660 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-unplugged-5fab64db-6099-4a48-b754-35b49c1cc414 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Instance destroyed successfully.
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lazy-loading 'resources' on Instance uuid 7d49ce3e-82ef-4c35-a217-4213791073b9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1449754410',display_name='tempest-AttachSCSIVolumeTestJSON-server-1449754410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1449754410',id=10,image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtYm9cnUo0Biu5wctlZtcoGXsjPvu/G143HQ16yGTQW34MsY2xfbOx7hS9jKyMG7O2zfYQ1krgLXlHXQI5qVVGgbbvn/KpEcCujPAZxMMxUZe01HYMdE82o+cs2bFgGSA==',key_name='tempest-keypair-180920959',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:40:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fac98a014eb243d4984474abf026c457',ramdisk_id='',reservation_id='r-ffv0dm08',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dac327e2-dd30-42b3-ace2-9a98bc7bfbc3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1840850624',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1840850624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:40:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='da57973acf5749bd9d64e4ff32aed6af',uuid=7d49ce3e-82ef-4c35-a217-4213791073b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converting VIF {"id": "5fab64db-6099-4a48-b754-35b49c1cc414", "address": "fa:16:3e:2e:1b:c6", "network": {"id": "d3dcc554-a01d-4831-b8b0-c772867b9089", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1552506362-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fac98a014eb243d4984474abf026c457", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fab64db-60", "ovs_interfaceid": "5fab64db-6099-4a48-b754-35b49c1cc414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_vif [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fab64db-60, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:02 user nova-compute[72810]: INFO os_vif [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:1b:c6,bridge_name='br-int',has_traffic_filtering=True,id=5fab64db-6099-4a48-b754-35b49c1cc414,network=Network(d3dcc554-a01d-4831-b8b0-c772867b9089),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fab64db-60')
Jul 31 18:42:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Deleting instance files /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9_del
Jul 31 18:42:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Deletion of /opt/stack/data/nova/instances/7d49ce3e-82ef-4c35-a217-4213791073b9_del complete
Jul 31 18:42:02 user nova-compute[72810]: INFO nova.compute.manager [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdYuqHJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:02 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a215fcf7-00ad-4850-b6ba-0d43a79eb25b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:42:02 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d731f2-f6a6-41d7-847f-e35e255cce36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5] added
Jul 31 18:42:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c7070-54bc-4f94-9799-6a057e6b4a8d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a1f199-c8cd-42eb-a1b5-ded09ac393c8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdYuqHJf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MdYuqHJf" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e715d6-aee1-4521-959a-ffd81654641e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MdYuqHJf'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c95b9d-3779-4bcb-9a31-c13d445db6a2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d56bcd-4815-4917-b29e-cb739fed0ce5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b7d5f-31d2-4443-86ec-5b2fb6f51828]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260]
Jul 31 18:42:03 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd5e47-5296-480b-ba77-63c06865dfa2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e2efc7-b253-4b67-91f2-2c154e041c76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[55640801-d160-443b-a130-ab33405fc063]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdYuqHJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690828908.6736577, c7aebd74-38c4-4925-8723-9d88596169cb => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:42:03 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Stopped (Lifecycle Event)
Jul 31 18:42:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-53c419b1-a9e8-4050-96d0-b9f9d44f9888 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-53c419b1-a9e8-4050-96d0-b9f9d44f9888 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:42:03 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:03 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Took 1.35 seconds to deallocate network for instance.
Jul 31 18:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] Acquiring lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] No waiting events found dispatching network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:04 user nova-compute[72810]: WARNING nova.compute.manager [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received unexpected event network-vif-plugged-5fab64db-6099-4a48-b754-35b49c1cc414 for instance with vm_state deleted and task_state None.
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-65aedf28-b83b-4173-91d8-da5eb47191dc req-c55abec2-35a0-4b4f-b135-30c562a69909 service nova] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Received event network-vif-deleted-5fab64db-6099-4a48-b754-35b49c1cc414 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23537346638316365', 'path': '/dev/sdh'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537346638316365', 'path': '/dev/sdh'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'flavor' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:42:04 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:42:04 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:42:04 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:42:04 user nova-compute[72810]:   <serial>93e3a1c3-8e35-498b-8911-8ae108e27bd5</serial>
Jul 31 18:42:04 user nova-compute[72810]: </disk>
Jul 31 18:42:04 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.012s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:05 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Deleted allocations for instance 7d49ce3e-82ef-4c35-a217-4213791073b9
Jul 31 18:42:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No VIF found with MAC fa:16:3e:62:6c:eb, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e20deef8-3dda-4bbb-a094-72596dc7262a tempest-AttachSCSIVolumeTestJSON-1840850624 tempest-AttachSCSIVolumeTestJSON-1840850624-project-member] Lock "7d49ce3e-82ef-4c35-a217-4213791073b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27b6ff38-56e5-48e4-8fb3-4d52df1af64d tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.509s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:06 user nova-compute[72810]: INFO nova.compute.manager [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Detaching volume 93e3a1c3-8e35-498b-8911-8ae108e27bd5
Jul 31 18:42:06 user nova-compute[72810]: INFO nova.virt.block_device [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Attempting to driver detach volume 93e3a1c3-8e35-498b-8911-8ae108e27bd5 from mountpoint /dev/vdb
Jul 31 18:42:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Attempting to detach device vdb from instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:42:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:42:06 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:42:06 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:42:06 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:42:06 user nova-compute[72810]:   <serial>93e3a1c3-8e35-498b-8911-8ae108e27bd5</serial>
Jul 31 18:42:06 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:42:06 user nova-compute[72810]: </disk>
Jul 31 18:42:06 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:42:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully detached device vdb from instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 from the persistent domain config.
Jul 31 18:42:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:42:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:42:06 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:42:06 user nova-compute[72810]:   <source dev="/dev/sdh"/>
Jul 31 18:42:06 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:42:06 user nova-compute[72810]:   <serial>93e3a1c3-8e35-498b-8911-8ae108e27bd5</serial>
Jul 31 18:42:06 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:42:06 user nova-compute[72810]: </disk>
Jul 31 18:42:06 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690828927.3118749, c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:42:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully detached device vdb from instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 from the live domain config.
Jul 31 18:42:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MdYuqHJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:07 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c1e13-b4e4-4b67-8873-71516380c99b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[21510ee9-fe5d-4c1a-8cd7-c33687df473c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec380670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5'): ({'sdh'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Removing single pathed devices sdh {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[289b4c0f-08fe-498e-aa8b-d8a54830f676]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[238f10cb-f3f8-489d-bf50-76305a700bf9]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Flushing IO for device /dev/sdh {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d527e05-53eb-4f57-a469-4575ee3e24d6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d1ac24-08e8-446b-9c8c-7a90e6ebef94]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a150b-35d6-4b80-9b88-cc644b7c136f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[46de6eb7-afe0-4764-9c91-1733e39abda0]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260]
Jul 31 18:42:07 user nova-compute[72810]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93e3a1c3-8e35-498b-8911-8ae108e27bd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576a992-391d-4679-89c6-1b5e1ac3246d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] <== disconnect_volume: return (343ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:42:08 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:09 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'flavor' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f3e1e72-9a7d-45df-ac90-b01e36b6b002 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.369s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:42:13 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:42:13 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=6780MB free_disk=25.61834716796875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1d690479-e8ce-427c-8008-daaf4ed124b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0ad2d315-6afe-4d01-98da-07d5c08548f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:42:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:42:14 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:42:14 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:42:14 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:42:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:17 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690828922.4956331, 7d49ce3e-82ef-4c35-a217-4213791073b9 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:42:17 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] VM Stopped (Lifecycle Event)
Jul 31 18:42:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-426a3bd5-a802-41ae-991f-92578d0eac57 None None] [instance: 7d49ce3e-82ef-4c35-a217-4213791073b9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:42:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:42:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-changed-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Refreshing instance network info cache due to event network-changed-6d0445ab-03f8-4ef5-9c98-970b6c0298fc. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] Acquiring lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] Acquired lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Refreshing network info cache for port 6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.objects.instance [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Ignoring supplied device name: /dev/vdb
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:35 user nova-compute[72810]: INFO nova.compute.manager [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Attaching volume 6e480ce1-8139-4520-b935-6a4df9450220 to /dev/vdb
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updated VIF entry in instance network info cache for port 6d0445ab-03f8-4ef5-9c98-970b6c0298fc. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updating instance_info_cache with network_info: [{"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e8fbaf2-10e3-47de-a723-0208d2b9b0fa req-b70add89-c7cd-44de-a53f-4886e96c7df7 service nova] Releasing lock "refresh_cache-ba030dcb-c9f2-4a7a-b426-3a2c1772582f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[36900f18-8c52-4fee-b2a3-7f3016ef2923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a83b1b-dd20-4f84-b64c-c3a88d7a9d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b94b2-f96c-4716-ad74-365a079f8f8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf8329-73d4-4520-865b-146ea43cf1e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:42:35 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:42:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f5618c-ce14-4c42-9419-6e3968c52be3]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updating existing volume attachment record: 043eea08-8aac-4de3-8007-4ff5a4d834ee {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:42:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-changed-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing instance network info cache due to event network-changed-77feced5-eb37-409a-897e-38396bf2277d. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] Acquiring lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] Acquired lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Refreshing network info cache for port 77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updated VIF entry in instance network info cache for port 77feced5-eb37-409a-897e-38396bf2277d. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c303e89-11db-4457-bfa8-35684cff174c req-54d9dad3-966b-453a-a90c-02012575cae5 service nova] Releasing lock "refresh_cache-84cfb6eb-d33c-4f07-8856-0c49901f0ec9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:42:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:40 user nova-compute[72810]: INFO nova.compute.manager [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Terminating instance
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-fbbeff4d-14f0-44c1-80be-6dfcde3b8129 req-be2aeaf2-430c-4bff-ad84-9ee8a8f0fc7a service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-77feced5-eb37-409a-897e-38396bf2277d for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-8ee8bb53-14e5-47e3-8cd1-dbe9ec8770b2 req-30cfcdf7-f762-4103-a465-f94533b81e5d service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-4dccc112-7920-4086-80db-e4ee7e4bb13f for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-4a5055cc-66a2-4879-bd7a-39f33641443a req-379ebc31-98ed-49be-8a22-b4247e0f74ec service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-3efd8eca-0296-4572-878b-427bcace84fc for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Instance destroyed successfully.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lazy-loading 'resources' on Instance uuid 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77feced5-eb, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:93:d4,bridge_name='br-int',has_traffic_filtering=True,id=77feced5-eb37-409a-897e-38396bf2277d,network=Network(9cbbc915-2cf0-437d-8fc2-4103ad0c45df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77feced5-eb')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dccc112-79, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:b8,bridge_name='br-int',has_traffic_filtering=True,id=4dccc112-7920-4086-80db-e4ee7e4bb13f,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4dccc112-79')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a735b41-7b, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a1:25,bridge_name='br-int',has_traffic_filtering=True,id=8a735b41-7bd0-424d-85b9-61082d370709,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a735b41-7b')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe2c9303-04, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-77feced5-eb37-409a-897e-38396bf2277d for instance with vm_state active and task_state deleting.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-8a735b41-7bd0-424d-85b9-61082d370709 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-8a735b41-7bd0-424d-85b9-61082d370709 for instance with vm_state active and task_state deleting.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-78fea470-7299-49de-a98b-5338590f7c41 req-400d6c96-8835-4102-9e73-538a263cc587 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:a4:0a,bridge_name='br-int',has_traffic_filtering=True,id=be2c9303-04a0-4602-8bda-4f60dd9a51cc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe2c9303-04')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "3efd8eca-0296-4572-878b-427bcace84fc", "address": "fa:16:3e:76:9d:41", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3efd8eca-02", "ovs_interfaceid": "3efd8eca-0296-4572-878b-427bcace84fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3efd8eca-02, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:9d:41,bridge_name='br-int',has_traffic_filtering=True,id=3efd8eca-0296-4572-878b-427bcace84fc,network=Network(8ff4bc56-e3a2-40d5-8544-cb46b9cff084),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3efd8eca-02')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9553687d-24, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:60:02,bridge_name='br-int',has_traffic_filtering=True,id=9553687d-24d3-4bd6-af0c-84abc5d9c35e,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9553687d-24')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:40:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-727134348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-727134348',id=12,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+5jfqdXWYly1DaZoZqzL9A3HhnofHftn87k2Iy5OxqFRSALzmxXodyL4RUx4kdM5ATAkUMUUuyKjnyLthtx5zsRUlL+tTXhK4JTjT9GFgwBgQaZD4W09qjB8NDv0G7/g==',key_name='tempest-keypair-59412885',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b065437c578e499489592685bf8637b5',ramdisk_id='',reservation_id='r-s18if25y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-638038997',owner_user_name='tempest-TaggedBootDevicesTest-638038997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0cf4e9343bc43afa1f50f475c603a19',uuid=84cfb6eb-d33c-4f07-8856-0c49901f0ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converting VIF {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647e4232-77, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:42 user nova-compute[72810]: INFO os_vif [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:13:3d,bridge_name='br-int',has_traffic_filtering=True,id=647e4232-7729-420b-a7a3-6e17cb3da3e7,network=Network(35603507-b27f-498d-9452-5a10da536e41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647e4232-77')
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zDsLIQvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52649a0a-5119-49b5-ad8a-d5b099cbd201]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6babb-04aa-4ecc-b867-a68f7a592e81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68fa0216c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-4dccc112-7920-4086-80db-e4ee7e4bb13f for instance with vm_state active and task_state deleting.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-be2c9303-04a0-4602-8bda-4f60dd9a51cc for instance with vm_state active and task_state deleting.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-unplugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-unplugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:42 user nova-compute[72810]: WARNING nova.compute.manager [req-76f28bb2-15f8-49bd-9b9f-a204b7cfbe1e req-f02dcdd1-78da-4335-8d19-20e4779ba0b8 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-9553687d-24d3-4bd6-af0c-84abc5d9c35e for instance with vm_state active and task_state deleting.
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f6854-517d-45d2-94a6-8c652130cf74]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e354bb5b-c0ad-4456-bafc-5406a41b744d]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a12a959-ace9-4e3a-bfe7-931520be22f1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b920d-f6c7-4565-9e78-73d53c66fd17]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[660945e3-4c45-42e0-9d5a-648063bc55e8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8457540-482c-4366-8e16-1cb7a70853f2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260]
Jul 31 18:42:43 user nova-compute[72810]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:43 user nova-compute[72810]: WARNING nova.compute.manager [req-46a376be-cbdb-4cde-a31e-4d9256ff4e96 req-08c2313d-0992-49ca-a40e-457310c18edb service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-3efd8eca-0296-4572-878b-427bcace84fc for instance with vm_state active and task_state deleting.
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fd5c0a4-33f1-4bca-afb9-32ada5e26e3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803666c-cbaa-42a6-bb59-bd30f92c2880]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== disconnect_volume: return (351ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJsizngq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:43 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e4543-6b47-4e0d-be69-cf892f1ebc83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa531d-c6a7-47ee-a876-11234b0f1cf9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4126950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ca531-ca47-4e21-95cd-ee696c1645ed]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e70dc1-83e7-44a6-b7c1-0e75ae9cdf02]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790fc54-596b-40df-8a22-be8ffa26d7d0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd449eb-6f91-43ff-b86e-4578405a2453]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[394da471-6f34-4c63-b444-0b4c37ed66d8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2639f4-5a44-4d58-bc56-9df7e54a033f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260]
Jul 31 18:42:43 user nova-compute[72810]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:771ea2a1-f7c6-43da-8658-9ac5d5f19052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba61acc-092c-4174-a371-10eec847296e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== disconnect_volume: return (283ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZBuQtvj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:43 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b1003-9694-416f-abb8-415245bde8b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[411e7827-623e-42c6-96ae-5c0277dfb419]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4126950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ed4446-1884-4949-856c-8fa811840e24]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cca83c7-559d-4579-a04a-86cd835ef578]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad321ac7-db4a-46d7-943b-a69c4c7c4f83]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56906c0-c40c-4770-a386-2be2e3df6e41]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a02fed-6a1a-4a13-a967-10011d6ed910]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f3eca3-01f2-4b17-be79-1d94a5ae02c8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260]
Jul 31 18:42:43 user nova-compute[72810]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b41f188-1e6c-4a83-adf3-f64c3dbd9e20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c0dd32-f6a5-4df1-ac56-6e54ddbc00aa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] <== disconnect_volume: return (293ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:42:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Deleting instance files /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9_del
Jul 31 18:42:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Deletion of /opt/stack/data/nova/instances/84cfb6eb-d33c-4f07-8856-0c49901f0ec9_del complete
Jul 31 18:42:43 user nova-compute[72810]: INFO nova.compute.manager [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Took 3.71 seconds to destroy the instance on the hypervisor.
Jul 31 18:42:43 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:42:43 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:42:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] Acquiring lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] No waiting events found dispatching network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:42:44 user nova-compute[72810]: WARNING nova.compute.manager [req-0ab9aaf2-7c25-4043-a487-07f3ae167b0f req-153dc90c-645a-410c-80c3-cc3b1b95dc31 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received unexpected event network-vif-plugged-647e4232-7729-420b-a7a3-6e17cb3da3e7 for instance with vm_state active and task_state deleting.
Jul 31 18:42:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUWYulkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:42:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:42:45 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b5eef-c646-45f4-8341-75a7b8a0a285]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:42:45 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4df6d-a5f2-4a8d-9d65-8f5210d5c7df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220] added
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d1233-7414-4aba-92fd-8e1c58b1c5cc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21fddec-6248-4bdb-92c1-9f63388ca99f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUWYulkS {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUWYulkS" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd52cd6-e29e-49b9-841a-3a529a9e9381]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUWYulkS'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1efd42-7684-4636-8dbc-3156e6b65c37]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347809c-672a-4d01-a9a4-88498236661c]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89bbe1-9e6b-4d84-a9f7-d4ecf7c28603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260]
Jul 31 18:42:45 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260] successful.
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d9494-384b-4622-ac92-e58e0fec07d1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c38e1b7-7077-4a44-acbf-f2e50fcbec77]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:42:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[64244c3b-c053-46ed-9bfd-0ea605ac21f5]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:42:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUWYulkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23164616338376661', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164616338376661', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:42:46 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:42:46 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:42:46 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:42:46 user nova-compute[72810]:   <serial>6e480ce1-8139-4520-b935-6a4df9450220</serial>
Jul 31 18:42:46 user nova-compute[72810]: </disk>
Jul 31 18:42:46 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No VIF found with MAC fa:16:3e:19:0b:b8, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-393edd6e-28dc-4f5e-8f25-65eb0be37ae2 req-633dc84d-dfcd-43a7-a7fc-241d66e7c036 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-deleted-3efd8eca-0296-4572-878b-427bcace84fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:46 user nova-compute[72810]: INFO nova.compute.manager [req-393edd6e-28dc-4f5e-8f25-65eb0be37ae2 req-633dc84d-dfcd-43a7-a7fc-241d66e7c036 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Neutron deleted interface 3efd8eca-0296-4572-878b-427bcace84fc; detaching it from the instance and deleting it from the info cache
Jul 31 18:42:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-393edd6e-28dc-4f5e-8f25-65eb0be37ae2 req-633dc84d-dfcd-43a7-a7fc-241d66e7c036 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "address": "fa:16:3e:a2:13:3d", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647e4232-77", "ovs_interfaceid": "647e4232-7729-420b-a7a3-6e17cb3da3e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-393edd6e-28dc-4f5e-8f25-65eb0be37ae2 req-633dc84d-dfcd-43a7-a7fc-241d66e7c036 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Detach interface failed, port_id=3efd8eca-0296-4572-878b-427bcace84fc, reason: Instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:42:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-84c5c7a3-131f-4dc2-85a2-169a58e4e855 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.600s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-deleted-647e4232-7729-420b-a7a3-6e17cb3da3e7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:49 user nova-compute[72810]: INFO nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Neutron deleted interface 647e4232-7729-420b-a7a3-6e17cb3da3e7; detaching it from the instance and deleting it from the info cache
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.network.neutron [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "address": "fa:16:3e:02:60:02", "network": {"id": "35603507-b27f-498d-9452-5a10da536e41", "bridge": "br-int", "label": "tempest-device-tagging-net2-178771155", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9553687d-24", "ovs_interfaceid": "9553687d-24d3-4bd6-af0c-84abc5d9c35e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Detach interface failed, port_id=647e4232-7729-420b-a7a3-6e17cb3da3e7, reason: Instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-deleted-9553687d-24d3-4bd6-af0c-84abc5d9c35e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:49 user nova-compute[72810]: INFO nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Neutron deleted interface 9553687d-24d3-4bd6-af0c-84abc5d9c35e; detaching it from the instance and deleting it from the info cache
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.network.neutron [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [{"id": "77feced5-eb37-409a-897e-38396bf2277d", "address": "fa:16:3e:67:93:d4", "network": {"id": "9cbbc915-2cf0-437d-8fc2-4103ad0c45df", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1002064531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77feced5-eb", "ovs_interfaceid": "77feced5-eb37-409a-897e-38396bf2277d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "address": "fa:16:3e:73:2a:b8", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dccc112-79", "ovs_interfaceid": "4dccc112-7920-4086-80db-e4ee7e4bb13f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a735b41-7bd0-424d-85b9-61082d370709", "address": "fa:16:3e:2e:a1:25", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a735b41-7b", "ovs_interfaceid": "8a735b41-7bd0-424d-85b9-61082d370709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "address": "fa:16:3e:50:a4:0a", "network": {"id": "8ff4bc56-e3a2-40d5-8544-cb46b9cff084", "bridge": "br-int", "label": "tempest-device-tagging-net1-2064348138", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b065437c578e499489592685bf8637b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe2c9303-04", "ovs_interfaceid": "be2c9303-04a0-4602-8bda-4f60dd9a51cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-ce7fbf73-1a59-44d0-845a-0f15b2bf331c req-7050b917-efd2-4e49-aea8-a85275f98c63 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Detach interface failed, port_id=9553687d-24d3-4bd6-af0c-84abc5d9c35e, reason: Instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:42:50 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:42:50 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Took 6.87 seconds to deallocate network for instance.
Jul 31 18:42:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-4de46669-0b25-4db2-90d8-ba6f344be420 req-10a3f1c5-5343-4aca-a9a8-27e8cb3eed33 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-deleted-be2c9303-04a0-4602-8bda-4f60dd9a51cc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-4de46669-0b25-4db2-90d8-ba6f344be420 req-10a3f1c5-5343-4aca-a9a8-27e8cb3eed33 service nova] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Received event network-vif-deleted-77feced5-eb37-409a-897e-38396bf2277d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:42:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:57 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690828962.198249, 84cfb6eb-d33c-4f07-8856-0c49901f0ec9 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:42:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] VM Stopped (Lifecycle Event)
Jul 31 18:42:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-5d8cf5b2-ae93-4ec6-bd6a-e3e4ce99b631 None None] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:42:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:42:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:42:59 user nova-compute[72810]: INFO nova.compute.claims [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Claim successful on node user
Jul 31 18:42:59 user nova-compute[72810]: INFO nova.compute.manager [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] [instance: 84cfb6eb-d33c-4f07-8856-0c49901f0ec9] Took 8.51 seconds to detach 3 volumes for instance.
Jul 31 18:42:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:42:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.665s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:43:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:43:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Creating image(s)
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "/opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "/opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.policy [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd457df295124730b399dbd1fbed9d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b8582394664644b7c51c435c4299ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.170s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.800s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.196s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:00 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Deleted allocations for instance 84cfb6eb-d33c-4f07-8856-0c49901f0ec9
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk 1073741824" returned: 0 in 0.052s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6918c238-bc62-476c-965e-ae5baa37124a tempest-TaggedBootDevicesTest-638038997 tempest-TaggedBootDevicesTest-638038997-project-member] Lock "84cfb6eb-d33c-4f07-8856-0c49901f0ec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.023s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Cannot resize image /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'migration_context' on Instance uuid 53ae5870-b8c6-4700-9ec7-a2671c01f44f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Ensure instance console log exists: /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:01 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Successfully created port: 072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Successfully updated port: 072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquired lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-changed-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Refreshing instance network info cache due to event network-changed-072cc23f-009a-43bf-b06b-71877c1a13a4. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] Acquiring lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Updating instance_info_cache with network_info: [{"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Releasing lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Instance network_info: |[{"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] Acquired lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Refreshing network info cache for port 072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Start _get_guest_xml network_info=[{"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:43:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346849437',display_name='tempest-VolumesAdminNegativeTest-server-1346849437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346849437',id=15,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-asvyk8w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:00Z,user_data=None,user_id='fd457df295124730b399dbd1fbed9d94',uuid=53ae5870-b8c6-4700-9ec7-a2671c01f44f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ae5870-b8c6-4700-9ec7-a2671c01f44f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:43:04 user nova-compute[72810]:   <uuid>53ae5870-b8c6-4700-9ec7-a2671c01f44f</uuid>
Jul 31 18:43:04 user nova-compute[72810]:   <name>instance-0000000f</name>
Jul 31 18:43:04 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:43:04 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:43:04 user nova-compute[72810]:   <metadata>
Jul 31 18:43:04 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:43:04 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1346849437</nova:name>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:43:04</nova:creationTime>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:43:04 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:43:04 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:owner>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:user uuid="fd457df295124730b399dbd1fbed9d94">tempest-VolumesAdminNegativeTest-2135289877-project-member</nova:user>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:project uuid="21b8582394664644b7c51c435c4299ab">tempest-VolumesAdminNegativeTest-2135289877</nova:project>
Jul 31 18:43:04 user nova-compute[72810]:       </nova:owner>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:43:04 user nova-compute[72810]:       <nova:ports>
Jul 31 18:43:04 user nova-compute[72810]:         <nova:port uuid="072cc23f-009a-43bf-b06b-71877c1a13a4">
Jul 31 18:43:04 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:43:04 user nova-compute[72810]:         </nova:port>
Jul 31 18:43:04 user nova-compute[72810]:       </nova:ports>
Jul 31 18:43:04 user nova-compute[72810]:     </nova:instance>
Jul 31 18:43:04 user nova-compute[72810]:   </metadata>
Jul 31 18:43:04 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:43:04 user nova-compute[72810]:     <system>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="serial">53ae5870-b8c6-4700-9ec7-a2671c01f44f</entry>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="uuid">53ae5870-b8c6-4700-9ec7-a2671c01f44f</entry>
Jul 31 18:43:04 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:43:04 user nova-compute[72810]:     </system>
Jul 31 18:43:04 user nova-compute[72810]:   </sysinfo>
Jul 31 18:43:04 user nova-compute[72810]:   <os>
Jul 31 18:43:04 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:43:04 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:43:04 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:43:04 user nova-compute[72810]:   </os>
Jul 31 18:43:04 user nova-compute[72810]:   <features>
Jul 31 18:43:04 user nova-compute[72810]:     <acpi/>
Jul 31 18:43:04 user nova-compute[72810]:     <apic/>
Jul 31 18:43:04 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:43:04 user nova-compute[72810]:   </features>
Jul 31 18:43:04 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:43:04 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:43:04 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:43:04 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:43:04 user nova-compute[72810]:   </clock>
Jul 31 18:43:04 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:43:04 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:43:04 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:43:04 user nova-compute[72810]:   </cpu>
Jul 31 18:43:04 user nova-compute[72810]:   <devices>
Jul 31 18:43:04 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:43:04 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:43:04 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk"/>
Jul 31 18:43:04 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:43:04 user nova-compute[72810]:     </disk>
Jul 31 18:43:04 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:43:04 user nova-compute[72810]:       <mac address="fa:16:3e:4a:07:4f"/>
Jul 31 18:43:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:04 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:43:04 user nova-compute[72810]:       <target dev="tap072cc23f-00"/>
Jul 31 18:43:04 user nova-compute[72810]:     </interface>
Jul 31 18:43:04 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:43:04 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/console.log" append="off"/>
Jul 31 18:43:04 user nova-compute[72810]:     </serial>
Jul 31 18:43:04 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:43:04 user nova-compute[72810]:     <video>
Jul 31 18:43:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:04 user nova-compute[72810]:     </video>
Jul 31 18:43:04 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:43:04 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:43:04 user nova-compute[72810]:     </rng>
Jul 31 18:43:04 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:43:04 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:43:04 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:43:04 user nova-compute[72810]:     </memballoon>
Jul 31 18:43:04 user nova-compute[72810]:   </devices>
Jul 31 18:43:04 user nova-compute[72810]: </domain>
Jul 31 18:43:04 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346849437',display_name='tempest-VolumesAdminNegativeTest-server-1346849437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346849437',id=15,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-asvyk8w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:00Z,user_data=None,user_id='fd457df295124730b399dbd1fbed9d94',uuid=53ae5870-b8c6-4700-9ec7-a2671c01f44f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG os_vif [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap072cc23f-00, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap072cc23f-00, col_values=(('external_ids', {'iface-id': '072cc23f-009a-43bf-b06b-71877c1a13a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:07:4f', 'vm-uuid': '53ae5870-b8c6-4700-9ec7-a2671c01f44f'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:04 user nova-compute[72810]: INFO os_vif [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00')
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] No VIF found with MAC fa:16:3e:4a:07:4f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Updated VIF entry in instance network info cache for port 072cc23f-009a-43bf-b06b-71877c1a13a4. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Updating instance_info_cache with network_info: [{"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19bcfaa7-e5d5-4495-a189-786300abaad8 req-167fe99c-5913-4b86-81ca-599144b34ee9 service nova] Releasing lock "refresh_cache-53ae5870-b8c6-4700-9ec7-a2671c01f44f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] No waiting events found dispatching network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:06 user nova-compute[72810]: WARNING nova.compute.manager [req-1531901d-2137-43a0-b9c6-74cca2283202 req-ea9f8b94-e1df-4f98-aa42-9790209b632e service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received unexpected event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 for instance with vm_state building and task_state spawning.
Jul 31 18:43:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828988.0794861, 53ae5870-b8c6-4700-9ec7-a2671c01f44f => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] VM Resumed (Lifecycle Event)
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Instance spawned successfully.
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690828988.0897942, 53ae5870-b8c6-4700-9ec7-a2671c01f44f => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] VM Started (Lifecycle Event)
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Took 7.92 seconds to spawn the instance on the hypervisor.
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] No waiting events found dispatching network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:08 user nova-compute[72810]: WARNING nova.compute.manager [req-c9c35249-68c2-48d1-b5b7-f498ee0ed368 req-6449634b-b13d-4555-9d9e-73eb211a58f6 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received unexpected event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 for instance with vm_state building and task_state spawning.
Jul 31 18:43:08 user nova-compute[72810]: INFO nova.compute.manager [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Took 9.28 seconds to build instance.
Jul 31 18:43:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3854a18c-aadf-4c0e-9927-e55d85895d11 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.509s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:09 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'flavor' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:11 user nova-compute[72810]: INFO nova.compute.manager [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attaching volume 492e9f72-7dae-4bd9-90b8-f13269254b8f to /dev/vdb
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.utils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf86a33-5746-4b11-9e7c-0990e3035e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40d2307-797e-4288-9dc3-a9c4e396da94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a377ef5-a5c5-4813-90e4-507fcbb4c64c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb9227-20e6-410b-9a3c-3d108047a550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:11 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec26eb4-db0d-4f5e-b8d0-48b37e13f0d9]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG os_brick.utils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating existing volume attachment record: 5c8ad07e-3066-4794-8301-a156e75fd05d {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:15 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:15 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7256MB free_disk=25.607845306396484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1d690479-e8ce-427c-8008-daaf4ed124b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0ad2d315-6afe-4d01-98da-07d5c08548f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 53ae5870-b8c6-4700-9ec7-a2671c01f44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:43:15 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.988s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:16 user nova-compute[72810]: INFO nova.compute.manager [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Detaching volume 6e480ce1-8139-4520-b935-6a4df9450220
Jul 31 18:43:16 user nova-compute[72810]: INFO nova.virt.block_device [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Attempting to driver detach volume 6e480ce1-8139-4520-b935-6a4df9450220 from mountpoint /dev/vdb
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Attempting to detach device vdb from instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:43:16 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:16 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:43:16 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:43:16 user nova-compute[72810]:   <serial>6e480ce1-8139-4520-b935-6a4df9450220</serial>
Jul 31 18:43:16 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:43:16 user nova-compute[72810]: </disk>
Jul 31 18:43:16 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully detached device vdb from instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f from the persistent domain config.
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:43:16 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:16 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:43:16 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:43:16 user nova-compute[72810]:   <serial>6e480ce1-8139-4520-b935-6a4df9450220</serial>
Jul 31 18:43:16 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:43:16 user nova-compute[72810]: </disk>
Jul 31 18:43:16 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:43:16 user nova-compute[72810]: INFO nova.compute.claims [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Claim successful on node user
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690828996.9543452, ba030dcb-c9f2-4a7a-b426-3a2c1772582f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:43:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully detached device vdb from instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f from the live domain config.
Jul 31 18:43:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUWYulkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:16 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7552a8d-757c-418d-bb8b-a7413caea563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae924f-f247-4011-a1df-b14daf9c60ce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f40df010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de3dff-61c1-451d-9b82-a8c612c2198a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[884de209-ed92-4d4a-a485-5adedc4f34d0]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d249290-46d2-4719-ba9b-2b98fa89ac51]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1272d1be-3864-47d6-bdb3-53fc81581b4b]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abae02b-d344-4608-bfc5-fcee00dd210e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4377bb-6fce-484f-ad33-8d26220c080d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260]
Jul 31 18:43:17 user nova-compute[72810]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7263f3-29a0-44a6-b4ba-1eef6d32147c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== disconnect_volume: return (362ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:43:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:43:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:43:17 user nova-compute[72810]: INFO nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Booting with volume 0e2183bc-e621-41f1-bd84-cf5d586d8281 at /dev/vda
Jul 31 18:43:17 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[35198fb7-1678-4c15-8765-d6706c029702]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6cbf23-c0c0-438e-9a0a-c9485aa0e70c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[892eea7a-d25b-46cc-b9be-c6ea404b77e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c377cb5-45e1-4216-a2f3-002b881146fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:18 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eda823-5b05-4fe0-92e9-64a0776f7c63]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating existing volume attachment record: 04912fae-64bc-4930-a476-1424e15e6a36 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG nova.policy [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c7914ceb46d40609b917ecc20114a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e10f67d01e8b423caedc3d8d09e50fe1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [{"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-98baf3f0-aed9-4075-a77b-ed6b697e5bc6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:43:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:20 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully created port: fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:43:21 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully created port: 8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:22 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully created port: f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully created port: df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully created port: 90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-fbd39ed7-b0d3-417c-a097-8cd2e8db0932. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:24 user nova-compute[72810]: DEBUG nova.network.neutron [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4b3cfd2d-0854-4e8e-a3cf-fb0be3c4ac8d req-a3abb4dc-b0cf-4fcf-ab03-66c938c485d2 service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47c564c6-fed6-4409-b97b-4bcafca5a1bc tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.256s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 10.089s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:26 user nova-compute[72810]: INFO nova.compute.manager [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Terminating instance
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'flavor' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:26 user nova-compute[72810]: INFO nova.compute.manager [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Attaching volume dc1ae67d-0e4b-44b6-b270-7370bede66d1 to /dev/vdb
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:26 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:26 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:26 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c2ffc-1dad-45dc-aaa1-4cb0e84d8242]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:26 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6778915-4abc-44ef-9aaf-a0f5d0497826]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f] added
Jul 31 18:43:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: 33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[42621a31-8f3a-4671-8234-648ad75fab87]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-e8aa4365-e127-46b7-b52f-37c4cfaaab04. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.utils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-unplugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] No waiting events found dispatching network-vif-unplugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-07c8c79a-6aff-4409-83ae-1acb746e4b3a req-fe8967f0-70ba-4d91-9a83-2b167b1a0d1d service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-unplugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3dca37-328c-4ecc-9816-e4120d672b8a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfZelSsK {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[10086c0a-42af-4f51-990d-f60c41a38113]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfZelSsK" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe7b315-5482-4760-b647-8e5ff55dc914]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfZelSsK'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6484f9e3-ada3-47ec-8b57-7e22826fa38c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[448966b2-b40d-420b-9249-c9376d75b74d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[180109b3-c36a-4575-bff9-6b861a1219c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f32cf-c969-45e3-82e7-4cc4a811563e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caaa50a-53a7-4216-9e30-1372c86adf12]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.network.neutron [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:27 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b41e115-b7e0-440e-9710-6bcdd626fcc5]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.utils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating existing volume attachment record: 566df584-5376-4f9e-8bb2-4ccc45c41bc4 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7ca63-08e9-4c8a-b278-d7b90ba326d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]
Jul 31 18:43:27 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f9c8b-2246-4353-9b07-5a9ff8bba647]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb423605-33dd-418a-bc0f-2b1640449ac9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f321d2b-5d36-4448-b465-17d6bb7f858c]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:43:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Instance destroyed successfully.
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'resources' on Instance uuid ba030dcb-c9f2-4a7a-b426-3a2c1772582f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:40:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1273429083',display_name='tempest-VolumesSnapshotTestJSON-instance-1273429083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1273429083',id=11,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8ucE8YuUSXuO3YYvVHuIX5wLwMaa+pxt8KEaHW1BW7Tfr6OCndiqvJpw6k2CSt3VPp7sXqD/erkG/4J1mn9aEyWWuAUMe9Z5D+aSOyiQwDid3fLxlI1cm6z5Fd7ljtBw==',key_name='tempest-keypair-1843738402',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-scl67aac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=ba030dcb-c9f2-4a7a-b426-3a2c1772582f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "address": "fa:16:3e:19:0b:b8", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0445ab-03", "ovs_interfaceid": "6d0445ab-03f8-4ef5-9c98-970b6c0298fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_vif [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d0445ab-03, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:27 user nova-compute[72810]: INFO os_vif [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:0b:b8,bridge_name='br-int',has_traffic_filtering=True,id=6d0445ab-03f8-4ef5-9c98-970b6c0298fc,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0445ab-03')
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUWYulkS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:27 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:27 user nova-compute[72810]: INFO nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Booting with volume 3b116e5b-6466-4bb5-af8a-444a5226a04e at /dev/vdb
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb67176-8023-4b22-b178-e5da9a070425]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.network.neutron [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e1cf8b-dfb1-4f5c-a028-be3a6a99f4b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ec123a13-52a7-4d36-b23f-350e17aabdca req-7fb0950a-e0b8-493b-a3bb-16896d5c9dba service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b29bc9-dc36-41cb-a9bc-287dee05089a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c767abf-0e25-4c68-859f-e60b05c69f6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:27 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f8b27-4bee-496b-97b2-41b899431492]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:27 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating existing volume attachment record: 982195e9-8987-4a11-ab02-2bdbb2666e69 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23166386538393130', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166386538393130', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.841s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e480ce1-8139-4520-b935-6a4df9450220', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'flavor' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c1eece-72d0-4372-91ea-56f513ddbb15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:43:28 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:28 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:43:28 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:43:28 user nova-compute[72810]:   <serial>492e9f72-7dae-4bd9-90b8-f13269254b8f</serial>
Jul 31 18:43:28 user nova-compute[72810]: </disk>
Jul 31 18:43:28 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[33221ac7-8f0e-44c9-9546-aec10076c4e4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4124430>, {}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Disconnecting from: [] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== disconnect_volume: return (902ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Deleting instance files /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f_del
Jul 31 18:43:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Deletion of /opt/stack/data/nova/instances/ba030dcb-c9f2-4a7a-b426-3a2c1772582f_del complete
Jul 31 18:43:28 user nova-compute[72810]: INFO nova.compute.manager [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Took 1.91 seconds to destroy the instance on the hypervisor.
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: 8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No VIF found with MAC fa:16:3e:03:73:f1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4d22ac19-55f5-47a2-817a-ac7b8a6ca21b tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.940s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port 33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] Acquiring lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] No waiting events found dispatching network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:29 user nova-compute[72810]: WARNING nova.compute.manager [req-ad8baf3a-efb5-472d-b959-f987f40aa299 req-149a854a-06e0-42c2-b2e6-31bc1f89d8fe service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received unexpected event network-vif-plugged-6d0445ab-03f8-4ef5-9c98-970b6c0298fc for instance with vm_state active and task_state deleting.
Jul 31 18:43:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-8ac7e333-c36b-4d18-a588-ad617e30c871. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port 8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:30 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-changed-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Refreshing instance network info cache due to event network-changed-df39a498-a56b-4dba-94c7-0faccbc50443. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Acquiring lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Acquired lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Refreshing network info cache for port df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d1daa9e6-35f0-4af8-96b7-a50d1e1d047d req-0842577c-5f50-4695-8910-aab69fbccc59 service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:32 user nova-compute[72810]: INFO nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Rebuilding instance
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Successfully updated port: 90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'pci_requests' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Took 3.92 seconds to deallocate network for instance.
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-61430c2c-583c-4194-92c4-b604a76ba463 req-76b7de06-d4e7-4148-8f51-0b8510eb2097 service nova] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Received event network-vif-deleted-6d0445ab-03f8-4ef5-9c98-970b6c0298fc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'resources' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: WARNING nova.volume.cinder [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Attachment 043eea08-8aac-4de3-8007-4ff5a4d834ee does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 043eea08-8aac-4de3-8007-4ff5a4d834ee. (HTTP 404) (Request-ID: req-c8b1f609-9266-4418-9892-2e8238059868)
Jul 31 18:43:32 user nova-compute[72810]: INFO nova.compute.manager [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'migration_context' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72810) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: INFO nova.compute.manager [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Rebuilding instance
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'resources' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'migration_context' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72810) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.695s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-df8f2c14-1ccf-4821-83b5-b75bd7970bc1. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance destroyed successfully.
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Deleted allocations for instance ba030dcb-c9f2-4a7a-b426-3a2c1772582f
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance destroyed successfully.
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-888682122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf39a498-a5, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:33 user nova-compute[72810]: INFO os_vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5')
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:33 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8702c453-63c4-4218-9477-e591694dfb86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6579d8c0-86f8-4e19-a93d-cb3791b19079 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "ba030dcb-c9f2-4a7a-b426-3a2c1772582f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.884s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a443a9-570f-41df-baa6-1317278a2257]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f40ddab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'): ({'sdg'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Removing single pathed devices sdg {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf8b29-da07-42b3-9304-bf9be909ff86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c97f6-e754-463a-9d1a-9e5ab8590f7e]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flushing IO for device /dev/sdg {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcac4d95-382e-4f05-b006-a6f666e40526]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updated VIF entry in instance network info cache for port df39a498-a56b-4dba-94c7-0faccbc50443. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating instance_info_cache with network_info: [{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Releasing lock "refresh_cache-1d690479-e8ce-427c-8008-daaf4ed124b1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-f170bd35-f99d-49bf-9d67-c5b9e95df724. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015c869-0a7c-4c1f-b66b-5cc2b7c30ba9]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] SCSI volumes sdg have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d523fd5-c938-437b-bfeb-020fe0290cb1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance destroyed successfully.
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.114s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fb7915-b9f2-4614-af5c-5fe160ac7f5d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]
Jul 31 18:43:33 user nova-compute[72810]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc75dc7e-28b4-45da-9a81-3abc66d6544f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== disconnect_volume: return (444ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deleting instance files /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1_del
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deletion of /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1_del complete
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.compute.manager [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Detaching volume 492e9f72-7dae-4bd9-90b8-f13269254b8f
Jul 31 18:43:33 user nova-compute[72810]: INFO nova.virt.block_device [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attempting to driver detach volume 492e9f72-7dae-4bd9-90b8-f13269254b8f from mountpoint /dev/vdb
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Attempting to detach device vdb from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:43:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:43:33 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:33 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:43:33 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:43:33 user nova-compute[72810]:   <serial>492e9f72-7dae-4bd9-90b8-f13269254b8f</serial>
Jul 31 18:43:33 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:43:33 user nova-compute[72810]: </disk>
Jul 31 18:43:33 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:43:34 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully detached device vdb from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the persistent domain config.
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:34 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc1ebb9-c680-4931-9b02-1a28622f0ee6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe2de1-645d-45f2-8136-1dfeb526f430]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4125bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1d690479-e8ce-427c-8008-daaf4ed124b1 could not be found.
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f88eea-6cb7-4802-b8c4-d7b6c2a35042]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:34 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6e274-fde2-4356-b1e6-abb730fb5990]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21980bf-d8d4-41dd-b055-c4e022fbd29d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c2d8c-6492-4995-b8c0-22a4d793f5ec]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacf5393-5d60-4d78-9954-f5878a55991e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d2a2f-9714-435c-810f-e1b082fd0bfb]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]
Jul 31 18:43:34 user nova-compute[72810]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:34 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa6beb-91cd-4290-adbb-47628ce627b6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== disconnect_volume: return (339ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.225s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f72a1-fb27-49e4-bc41-794df54cde7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d5e882-1863-4848-a8bc-52c2b6add82b]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:34 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f9fbc700>, {}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Disconnecting from: [] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== disconnect_volume: return (276ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:34 user nova-compute[72810]: WARNING nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state rebuilding.
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:34 user nova-compute[72810]: WARNING nova.compute.manager [req-ba27b22e-af37-4001-9e05-fe9998fd10ea req-bf3116a2-3bcc-463b-aefd-2c047168dacb service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state rebuilding.
Jul 31 18:43:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:35 user nova-compute[72810]: WARNING nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state active and task_state rebuilding.
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:35 user nova-compute[72810]: WARNING nova.compute.manager [req-0392da01-4b90-49c8-b273-ebd793ef1819 req-1ec65eda-eb7f-4e2a-82a4-9de09e6a1976 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state active and task_state rebuilding.
Jul 31 18:43:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance destroyed successfully.
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-635685006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54438c8e-25, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:35 user nova-compute[72810]: INFO os_vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25')
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:35 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c717f-fa38-4950-9c02-6498d8668252]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f0a33e-391c-4817-9244-092e5c90cde2]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:35 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:35 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f9fbc9d0>, {}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Disconnecting from: [] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== disconnect_volume: return (56ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Deleting instance files /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1_del
Jul 31 18:43:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Deletion of /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1_del complete
Jul 31 18:43:35 user nova-compute[72810]: INFO nova.virt.block_device [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Booting with volume 492e9f72-7dae-4bd9-90b8-f13269254b8f at /dev/vdb
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.network.neutron [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Preparing to wait for external event volume-reimaged-ad023e56-151e-454f-bf0c-853c0fdc0601 {{(pid=72810) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance network_info: |[{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updated VIF entry in instance network info cache for port df8f2c14-1ccf-4821-83b5-b75bd7970bc1. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-90f1212f-f1af-4124-8604-c56b47069dd7. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port 90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.utils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ec37f-9d96-4670-9c6c-62a334ecc27d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2bcc3b-9a93-4fc8-9d4c-57af63c26f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4358fd04-0522-4149-8b12-65f050365357]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420afbc-bd2f-41ac-b3f8-d7bd28f9679d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:36 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af0a95a-1bf1-4bde-8c5a-3c1dc713014d]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG os_brick.utils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:36 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating existing volume attachment record: b63eb883-15c2-4cac-8ecf-837ac9a256ab {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updated VIF entry in instance network info cache for port 90f1212f-f1af-4124-8604-c56b47069dd7. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b50ca549-e06f-4456-8f3f-6134a03a5f32 req-2baf44c0-5490-4af7-920d-2a03f9d0a96c service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updated VIF entry in instance network info cache for port f170bd35-f99d-49bf-9d67-c5b9e95df724. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9089f8fb-38ab-4def-a8bf-10044823b9a3 req-6f326465-4ba4-4321-9bc6-a1f4ed1f6b3a service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'info_cache' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:38 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:38 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:38 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc85af-1ed5-44cc-a59f-d2197eee0557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:38 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cd1eb-e9e0-406f-8096-20864ae9d953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added
Jul 31 18:43:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1b9c1-90f6-485a-acb0-cd98fba98683]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[174d4b1b-5e5e-47d6-98e5-15257cdcc86e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e939e291-193b-47d2-8dbb-75c0d3195ee6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PsOniwBN'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7b63d-1909-4980-b6d3-cc29f1b228ef]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d64c781-dce5-4d8f-adb2-a9ea95051f55]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9ed62-1e5e-41ad-a388-773e0a12a623]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:43:39 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[398d23ce-ace1-461e-82dc-fd6af0f3471d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[361bf34c-60bf-407b-9d31-f877fa1d48bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bfe3a3-c0b6-493f-8311-987f38c6ee02]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:43:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance destroyed successfully.
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'resources' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0013d9f-8a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:39 user nova-compute[72810]: INFO os_vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:43:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:39 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.955s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'flavor' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb931a11-0a1a-4ca2-8e3a-207f385aaab0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:43:40 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:40 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:43:40 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:43:40 user nova-compute[72810]:   <serial>dc1ae67d-0e4b-44b6-b270-7370bede66d1</serial>
Jul 31 18:43:40 user nova-compute[72810]: </disk>
Jul 31 18:43:40 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e4988a-f0da-46e4-b8c9-c969d4421674]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5a48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[85edfa33-76ee-4e8e-839a-cc02a007bc4d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61a9cf-2d6e-497c-8bc3-cbe62ff79339]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7c840e-ab82-4872-b985-85c1627b4711]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[028127e2-9de1-4a91-bc24-14d80c728c85]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad896c1f-993f-496f-b45c-fc4b3424952b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db25608-046a-4403-9720-227c7f125df1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]
Jul 31 18:43:40 user nova-compute[72810]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d6d0a-4462-42c9-9499-ff7177f453b8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== disconnect_volume: return (1312ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start _get_guest_xml network_info=[{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'c7aebd74-38c4-4925-8723-9d88596169cb', 'attached_at': '', 'detached_at': '', 'volume_id': '83f24d4b-26c4-4a56-8ffd-700412d64596', 'serial': '83f24d4b-26c4-4a56-8ffd-700412d64596'}, 'attachment_id': '256256d7-6a05-462c-b07b-46cdd244ede9', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'numa_topology' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:40 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:40 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:40 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[321acc97-1f4b-4d1a-9b37-3a76750e8ae7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:40 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No VIF found with MAC fa:16:3e:04:7a:fa, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b0bcfb-7267-4b81-b177-7b4cfd2672df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596] added
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[357d6a7d-0f39-40c9-b0a0-e56deb14acc9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0848d05-44c0-4ab3-8b1c-af6e7bbd4861]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcJvLwKI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcJvLwKI" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3565b838-f7f3-4021-824e-700fa605337f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcJvLwKI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35f4490-4f0f-43f7-84cb-9ee878790b2d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9d2c66-1642-4305-a29e-25fc5fb45de7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:40 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c0ce97ee-02b1-4e59-8978-6a343aef8c70 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.224s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e633a-44d3-41d1-9f20-0f6dafd04caf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]
Jul 31 18:43:41 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59b459-6568-4f4b-8fca-d62d56ebf4b1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6cc8c9-2f20-424f-926d-bd1cb19e900b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3859cdcd-a96f-4d7a-851b-179a9535365a]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23861333337336463', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861333337336463', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'pci_devices' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:43:42 user nova-compute[72810]:   <uuid>c7aebd74-38c4-4925-8723-9d88596169cb</uuid>
Jul 31 18:43:42 user nova-compute[72810]:   <name>instance-00000008</name>
Jul 31 18:43:42 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:43:42 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:43:42 user nova-compute[72810]:   <metadata>
Jul 31 18:43:42 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:43:42 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeTestJSON-server-2077908289</nova:name>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:43:40</nova:creationTime>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:43:42 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:43:42 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:owner>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:user uuid="3b2bbbd7a792431688c8d575d2c71d21">tempest-AttachVolumeTestJSON-1714901238-project-member</nova:user>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:project uuid="15a633ca9965410aa6ce5b2b86a6f198">tempest-AttachVolumeTestJSON-1714901238</nova:project>
Jul 31 18:43:42 user nova-compute[72810]:       </nova:owner>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:43:42 user nova-compute[72810]:       <nova:ports>
Jul 31 18:43:42 user nova-compute[72810]:         <nova:port uuid="e0013d9f-8ad7-4d9e-8874-6987d6db9c9c">
Jul 31 18:43:42 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:43:42 user nova-compute[72810]:         </nova:port>
Jul 31 18:43:42 user nova-compute[72810]:       </nova:ports>
Jul 31 18:43:42 user nova-compute[72810]:     </nova:instance>
Jul 31 18:43:42 user nova-compute[72810]:   </metadata>
Jul 31 18:43:42 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:43:42 user nova-compute[72810]:     <system>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="serial">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="uuid">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:43:42 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:43:42 user nova-compute[72810]:     </system>
Jul 31 18:43:42 user nova-compute[72810]:   </sysinfo>
Jul 31 18:43:42 user nova-compute[72810]:   <os>
Jul 31 18:43:42 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:43:42 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:43:42 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:43:42 user nova-compute[72810]:   </os>
Jul 31 18:43:42 user nova-compute[72810]:   <features>
Jul 31 18:43:42 user nova-compute[72810]:     <acpi/>
Jul 31 18:43:42 user nova-compute[72810]:     <apic/>
Jul 31 18:43:42 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:43:42 user nova-compute[72810]:   </features>
Jul 31 18:43:42 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:43:42 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:43:42 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:43:42 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:43:42 user nova-compute[72810]:   </clock>
Jul 31 18:43:42 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:43:42 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:43:42 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:43:42 user nova-compute[72810]:   </cpu>
Jul 31 18:43:42 user nova-compute[72810]:   <devices>
Jul 31 18:43:42 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:43:42 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:43:42 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk"/>
Jul 31 18:43:42 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:43:42 user nova-compute[72810]:     </disk>
Jul 31 18:43:42 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:43:42 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:42 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:43:42 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:43:42 user nova-compute[72810]:       <serial>83f24d4b-26c4-4a56-8ffd-700412d64596</serial>
Jul 31 18:43:42 user nova-compute[72810]:     </disk>
Jul 31 18:43:42 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:43:42 user nova-compute[72810]:       <mac address="fa:16:3e:ed:6c:7c"/>
Jul 31 18:43:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:42 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:43:42 user nova-compute[72810]:       <target dev="tape0013d9f-8a"/>
Jul 31 18:43:42 user nova-compute[72810]:     </interface>
Jul 31 18:43:42 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:43:42 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/console.log" append="off"/>
Jul 31 18:43:42 user nova-compute[72810]:     </serial>
Jul 31 18:43:42 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:43:42 user nova-compute[72810]:     <video>
Jul 31 18:43:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:42 user nova-compute[72810]:     </video>
Jul 31 18:43:42 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:43:42 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:43:42 user nova-compute[72810]:     </rng>
Jul 31 18:43:42 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:43:42 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:43:42 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:43:42 user nova-compute[72810]:     </memballoon>
Jul 31 18:43:42 user nova-compute[72810]:   </devices>
Jul 31 18:43:42 user nova-compute[72810]: </domain>
Jul 31 18:43:42 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829007.3626294, ba030dcb-c9f2-4a7a-b426-3a2c1772582f => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:42 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] VM Stopped (Lifecycle Event)
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1a37fb77-c8e2-42fc-a93d-64d796dc399f None None] [instance: ba030dcb-c9f2-4a7a-b426-3a2c1772582f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Cannot resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'migration_context' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:41:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG os_vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0013d9f-8a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0013d9f-8a, col_values=(('external_ids', {'iface-id': 'e0013d9f-8ad7-4d9e-8874-6987d6db9c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:6c:7c', 'vm-uuid': 'c7aebd74-38c4-4925-8723-9d88596169cb'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:42 user nova-compute[72810]: INFO os_vif [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:43:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Stashing vm_state: active {{(pid=72810) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'pci_requests' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:43:43 user nova-compute[72810]: INFO nova.compute.claims [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Claim successful on node user
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'resources' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:43 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating resource usage from migration 28747608-e0df-4b68-b69b-85dc851a090d
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.555s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:43 user nova-compute[72810]: INFO nova.compute.manager [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Migrating
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:43 user nova-compute[72810]: INFO nova.compute.rpcapi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:43 user nova-compute[72810]: DEBUG nova.network.neutron [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-changed-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Refreshing instance network info cache due to event network-changed-5732244a-409f-49ec-af65-480aa2a14459. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] Acquiring lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] Acquired lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.network.neutron [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Refreshing network info cache for port 5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:44 user nova-compute[72810]: WARNING nova.compute.manager [req-e723abea-8d1e-4589-bf6d-10c013456fbe req-60af262f-a146-4e68-ad06-3fb4f83becbe service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state powering-on.
Jul 31 18:43:44 user nova-compute[72810]: DEBUG nova.network.neutron [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Starting migrate_disk_and_power_off {{(pid=72810) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: INFO nova.compute.manager [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Terminating instance
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: INFO nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Booting with volume 11597ad3-9bdc-412b-99b9-7d714798c55b at /dev/vdc
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5b692e-0e39-4d6a-a161-a583b80fd8a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8903cd-ebc5-4be0-88cb-20f4de1df55f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[394df71a-0410-4c24-8e96-765440a609d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9501c0-eca0-4e50-90b0-2a39dfadd5c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:45 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[836238cb-3d25-44f0-88f4-880eb5d7c5ff]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG os_brick.utils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:45 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating existing volume attachment record: f65a206e-b744-41d8-b143-c7bd2d2e0ea9 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updated VIF entry in instance network info cache for port 5732244a-409f-49ec-af65-480aa2a14459. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updating instance_info_cache with network_info: [{"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8121f29f-d8ed-4139-930d-a92addd97334 req-472a8c5a-bcc0-45da-9957-6a422795b240 service nova] Releasing lock "refresh_cache-0ad2d315-6afe-4d01-98da-07d5c08548f7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance destroyed successfully.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f869796-d8, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Instance destroyed successfully.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'resources' on Instance uuid 0ad2d315-6afe-4d01-98da-07d5c08548f7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: INFO os_vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:46 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:41:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888846141',display_name='tempest-AttachVolumeNegativeTest-server-1888846141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888846141',id=14,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLq1hvNwWm7CwCKe/PtzoqIxXzfhkkafoZo0sNA3Ukti6RuYCZnsdDk8mgxC9SN1MpAU1lZOyBnZOti6m7zI6LpN5l/aq6p8TtdAIPxKAArHtKL1JsDTo1nOljlVCkJkg==',key_name='tempest-keypair-290784274',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-sv0efcoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:42:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=0ad2d315-6afe-4d01-98da-07d5c08548f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "5732244a-409f-49ec-af65-480aa2a14459", "address": "fa:16:3e:76:b9:b1", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5732244a-40", "ovs_interfaceid": "5732244a-409f-49ec-af65-480aa2a14459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_vif [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5732244a-40, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:46 user nova-compute[72810]: INFO os_vif [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:b9:b1,bridge_name='br-int',has_traffic_filtering=True,id=5732244a-409f-49ec-af65-480aa2a14459,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5732244a-40')
Jul 31 18:43:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Deleting instance files /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7_del
Jul 31 18:43:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Deletion of /opt/stack/data/nova/instances/0ad2d315-6afe-4d01-98da-07d5c08548f7_del complete
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efeba1f-3aed-4998-a755-e5734b2a1e15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f4f136-e114-4e4e-8dfc-3b3ceb1f98db]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec118c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bca8b9-fcae-403b-b3a4-6def0b5fbd4f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: INFO nova.compute.manager [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Took 1.29 seconds to destroy the instance on the hypervisor.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a730f0d-2c03-4abf-9546-1a8e5db91d34]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1c3710-7b03-4d4c-8f14-e380738237e7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2ae34c-2d02-49c8-9525-ad29e189c892]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:46 user nova-compute[72810]: WARNING nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state active and task_state resize_migrating.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:46 user nova-compute[72810]: WARNING nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state active and task_state resize_migrating.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-unplugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] No waiting events found dispatching network-vif-unplugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-56850751-c184-4d9e-805f-bda79b147a71 req-c2ffc637-b5aa-44b4-97e0-f7f90f17f03f service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-unplugged-5732244a-409f-49ec-af65-480aa2a14459 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f477b-0725-4458-95ee-fbc79756d2c8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f854ea9-1868-42c3-9304-5aa3d30e33f9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:43:46 user nova-compute[72810]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe38fc-d45f-4700-b618-3b037b5ac02e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== disconnect_volume: return (409ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:46 user nova-compute[72810]: WARNING nova.compute.manager [req-949d3416-493b-49ba-b4e1-a0942a337b6d req-8bfd5b98-60c4-45df-8e91-9fe64197727b service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state powering-on.
Jul 31 18:43:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_resize/disk /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:43:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Creating image(s)
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829027.4747381, c7aebd74-38c4-4925-8723-9d88596169cb => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Resumed (Lifecycle Event)
Jul 31 18:43:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance rebooted successfully.
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-657c917a-718c-42a5-92d2-70b3531a2026 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829027.4830928, c7aebd74-38c4-4925-8723-9d88596169cb => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Started (Lifecycle Event)
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "cp -r /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_resize/disk /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk" returned: 0 in 0.312s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_resize/disk.info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk.info {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "cp -r /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_resize/disk.info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk.info" returned: 0 in 0.059s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.219s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk 1073741824" returned: 0 in 0.058s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Cannot resize image /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Ensure instance console log exists: /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start _get_guest_xml network_info=[{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e9cae76-2122-436a-868b-bb8c500abfe1', 'attached_at': '', 'detached_at': '', 'volume_id': '492e9f72-7dae-4bd9-90b8-f13269254b8f', 'serial': '492e9f72-7dae-4bd9-90b8-f13269254b8f'}, 'attachment_id': 'b63eb883-15c2-4cac-8ecf-837ac9a256ab', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829013.1921175, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Stopped (Lifecycle Event)
Jul 31 18:43:48 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 18:43:48 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-bee09b85-5f11-4b7a-a81f-f56c776d42fd req-1f63b577-5961-4f33-bbee-6758e2b28207 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-deleted-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:48 user nova-compute[72810]: INFO nova.compute.manager [req-bee09b85-5f11-4b7a-a81f-f56c776d42fd req-1f63b577-5961-4f33-bbee-6758e2b28207 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Neutron deleted interface 5732244a-409f-49ec-af65-480aa2a14459; detaching it from the instance and deleting it from the info cache
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.network.neutron [req-bee09b85-5f11-4b7a-a81f-f56c776d42fd req-1f63b577-5961-4f33-bbee-6758e2b28207 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-5678c609-281f-4298-8b1a-ac63bdb371cf None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:48 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Took 1.71 seconds to deallocate network for instance.
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-bee09b85-5f11-4b7a-a81f-f56c776d42fd req-1f63b577-5961-4f33-bbee-6758e2b28207 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Detach interface failed, port_id=5732244a-409f-49ec-af65-480aa2a14459, reason: Instance 0ad2d315-6afe-4d01-98da-07d5c08548f7 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3db683-e9c0-4f1d-b250-49d297ade378]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:48 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de8c7c-c964-48ab-b1ab-a66ad7718b0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f] added
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bebe1b7-f7a2-4d64-aae7-327a0f127f92]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fdd421-debe-46c3-93a1-994d9ffe7ea7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfZelSsK {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfZelSsK" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dffa6e9-8af9-4fe7-abf1-0f2d1bbce4de]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfZelSsK'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bed77-19f5-41b5-8e25-653fdaa99c51]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc46acd-aafd-42cd-bc60-08115acfd075]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afeffe9-64f8-4d84-91b8-aa155f8a044c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]
Jul 31 18:43:48 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7a8794-c8a0-465f-be8d-2cf196956027]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3151baab-6acb-4e17-a040-819cae790d0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:48 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829013.7208648, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Stopped (Lifecycle Event)
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a41ce8-134f-4ed5-a055-a22cf44cfd3b]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e899a180-b671-485f-8eee-ec1811eb3d11 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] Acquiring lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] No waiting events found dispatching network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:48 user nova-compute[72810]: WARNING nova.compute.manager [req-001aae14-6ece-4006-8c50-46e7aa43ac5a req-794f3a5e-5d7e-4ff4-a264-571ab6b8a173 service nova] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Received unexpected event network-vif-plugged-5732244a-409f-49ec-af65-480aa2a14459 for instance with vm_state deleted and task_state None.
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:48 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.638s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:43:49 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Deleted allocations for instance 0ad2d315-6afe-4d01-98da-07d5c08548f7
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Port 8f869796-d849-427e-91fe-d54efcdb4674 binding to destination host user is already ACTIVE {{(pid=72810) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6aba37fe-aa34-4f45-9426-d8f13866adb8 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "0ad2d315-6afe-4d01-98da-07d5c08548f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.948s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:43:49 user nova-compute[72810]: INFO nova.compute.claims [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Claim successful on node user
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23166386538393130', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166386538393130', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-635685006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:43:49 user nova-compute[72810]:   <uuid>1e9cae76-2122-436a-868b-bb8c500abfe1</uuid>
Jul 31 18:43:49 user nova-compute[72810]:   <name>instance-00000001</name>
Jul 31 18:43:49 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:43:49 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:43:49 user nova-compute[72810]:   <metadata>
Jul 31 18:43:49 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:43:49 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherA-server-635685006</nova:name>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:43:48</nova:creationTime>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:43:49 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:43:49 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:owner>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:user uuid="a818426c4f424127a01cb9f57e076603">tempest-ServerActionsTestOtherA-1074391512-project-member</nova:user>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:project uuid="38248d933d4d42a9aca885b10fbd1afa">tempest-ServerActionsTestOtherA-1074391512</nova:project>
Jul 31 18:43:49 user nova-compute[72810]:       </nova:owner>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:43:49 user nova-compute[72810]:       <nova:ports>
Jul 31 18:43:49 user nova-compute[72810]:         <nova:port uuid="54438c8e-25a3-411a-b897-df13142f4016">
Jul 31 18:43:49 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 18:43:49 user nova-compute[72810]:         </nova:port>
Jul 31 18:43:49 user nova-compute[72810]:       </nova:ports>
Jul 31 18:43:49 user nova-compute[72810]:     </nova:instance>
Jul 31 18:43:49 user nova-compute[72810]:   </metadata>
Jul 31 18:43:49 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:43:49 user nova-compute[72810]:     <system>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="serial">1e9cae76-2122-436a-868b-bb8c500abfe1</entry>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="uuid">1e9cae76-2122-436a-868b-bb8c500abfe1</entry>
Jul 31 18:43:49 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:43:49 user nova-compute[72810]:     </system>
Jul 31 18:43:49 user nova-compute[72810]:   </sysinfo>
Jul 31 18:43:49 user nova-compute[72810]:   <os>
Jul 31 18:43:49 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:43:49 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:43:49 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:43:49 user nova-compute[72810]:   </os>
Jul 31 18:43:49 user nova-compute[72810]:   <features>
Jul 31 18:43:49 user nova-compute[72810]:     <acpi/>
Jul 31 18:43:49 user nova-compute[72810]:     <apic/>
Jul 31 18:43:49 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:43:49 user nova-compute[72810]:   </features>
Jul 31 18:43:49 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:43:49 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:43:49 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:43:49 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:43:49 user nova-compute[72810]:   </clock>
Jul 31 18:43:49 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:43:49 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:43:49 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:43:49 user nova-compute[72810]:   </cpu>
Jul 31 18:43:49 user nova-compute[72810]:   <devices>
Jul 31 18:43:49 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:43:49 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:43:49 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk"/>
Jul 31 18:43:49 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:43:49 user nova-compute[72810]:     </disk>
Jul 31 18:43:49 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:43:49 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:43:49 user nova-compute[72810]:       <source dev="/dev/sdd"/>
Jul 31 18:43:49 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:43:49 user nova-compute[72810]:       <serial>492e9f72-7dae-4bd9-90b8-f13269254b8f</serial>
Jul 31 18:43:49 user nova-compute[72810]:     </disk>
Jul 31 18:43:49 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:43:49 user nova-compute[72810]:       <mac address="fa:16:3e:03:73:f1"/>
Jul 31 18:43:49 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:49 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:43:49 user nova-compute[72810]:       <target dev="tap54438c8e-25"/>
Jul 31 18:43:49 user nova-compute[72810]:     </interface>
Jul 31 18:43:49 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:43:49 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/console.log" append="off"/>
Jul 31 18:43:49 user nova-compute[72810]:     </serial>
Jul 31 18:43:49 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:43:49 user nova-compute[72810]:     <video>
Jul 31 18:43:49 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:49 user nova-compute[72810]:     </video>
Jul 31 18:43:49 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:43:49 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:43:49 user nova-compute[72810]:     </rng>
Jul 31 18:43:49 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:43:49 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:43:49 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:43:49 user nova-compute[72810]:     </memballoon>
Jul 31 18:43:49 user nova-compute[72810]:   </devices>
Jul 31 18:43:49 user nova-compute[72810]: </domain>
Jul 31 18:43:49 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-635685006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG os_vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54438c8e-25, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54438c8e-25, col_values=(('external_ids', {'iface-id': '54438c8e-25a3-411a-b897-df13142f4016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:73:f1', 'vm-uuid': '1e9cae76-2122-436a-868b-bb8c500abfe1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:50 user nova-compute[72810]: INFO os_vif [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25')
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No VIF found with MAC fa:16:3e:03:73:f1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:43:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.policy [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae78538787b4a37990ba448a59dcb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e21ca5b7ebc497cafb9af2f79cb6453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:43:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Creating image(s)
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "/opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "/opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "/opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.utils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.215s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8f5f1-adea-42a5-b34b-b0bea318426e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40e661b-ad55-4034-9aa7-92b0cb107a01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534b9a1-1651-4238-987e-992df519f9be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ce28fb-66bb-40bd-a881-45a034023435]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:50 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85eed1-9b20-4c55-9da4-b43906aeedeb]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:50 user nova-compute[72810]: DEBUG os_brick.utils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk 1073741824" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.211s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Successfully created port: 13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Cannot resize image /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'migration_context' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Ensure instance console log exists: /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:52 user nova-compute[72810]: WARNING nova.compute.manager [req-d5f04359-bb04-44b0-a0cf-aaa70af0f1d8 req-8785e458-a2ed-4797-934e-3641ec287dbc service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 18:43:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Successfully updated port: 13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquired lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating instance_info_cache with network_info: [{"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Releasing lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Instance network_info: |[{"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Start _get_guest_xml network_info=[{"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:43:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1682289298',display_name='tempest-TestVolumeSwap-server-1682289298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1682289298',id=17,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBctQYODPgd3GwLvxg6v6/tb21AD9RhadEzdK4HL86GGH90gv5zuQer5DfUCZAriopcL6N6FBXNqS7vdTExlYKfPetfpWa0THkwpNtAXcojqS++gyol8VfGWTehNkePNag==',key_name='tempest-keypair-2022165580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e21ca5b7ebc497cafb9af2f79cb6453',ramdisk_id='',reservation_id='r-c55x4f8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-993383493',owner_user_name='tempest-TestVolumeSwap-993383493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae78538787b4a37990ba448a59dcb60',uuid=d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converting VIF {"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'pci_devices' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:43:53 user nova-compute[72810]:   <uuid>d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5</uuid>
Jul 31 18:43:53 user nova-compute[72810]:   <name>instance-00000011</name>
Jul 31 18:43:53 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:43:53 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:43:53 user nova-compute[72810]:   <metadata>
Jul 31 18:43:53 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:43:53 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:name>tempest-TestVolumeSwap-server-1682289298</nova:name>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:43:53</nova:creationTime>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:43:53 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:43:53 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:owner>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:user uuid="4ae78538787b4a37990ba448a59dcb60">tempest-TestVolumeSwap-993383493-project-member</nova:user>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:project uuid="2e21ca5b7ebc497cafb9af2f79cb6453">tempest-TestVolumeSwap-993383493</nova:project>
Jul 31 18:43:53 user nova-compute[72810]:       </nova:owner>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:43:53 user nova-compute[72810]:       <nova:ports>
Jul 31 18:43:53 user nova-compute[72810]:         <nova:port uuid="13e413db-6d28-4650-acae-7cd364b74b2a">
Jul 31 18:43:53 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 18:43:53 user nova-compute[72810]:         </nova:port>
Jul 31 18:43:53 user nova-compute[72810]:       </nova:ports>
Jul 31 18:43:53 user nova-compute[72810]:     </nova:instance>
Jul 31 18:43:53 user nova-compute[72810]:   </metadata>
Jul 31 18:43:53 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:43:53 user nova-compute[72810]:     <system>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="serial">d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5</entry>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="uuid">d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5</entry>
Jul 31 18:43:53 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:43:53 user nova-compute[72810]:     </system>
Jul 31 18:43:53 user nova-compute[72810]:   </sysinfo>
Jul 31 18:43:53 user nova-compute[72810]:   <os>
Jul 31 18:43:53 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:43:53 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:43:53 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:43:53 user nova-compute[72810]:   </os>
Jul 31 18:43:53 user nova-compute[72810]:   <features>
Jul 31 18:43:53 user nova-compute[72810]:     <acpi/>
Jul 31 18:43:53 user nova-compute[72810]:     <apic/>
Jul 31 18:43:53 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:43:53 user nova-compute[72810]:   </features>
Jul 31 18:43:53 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:43:53 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:43:53 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:43:53 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:43:53 user nova-compute[72810]:   </clock>
Jul 31 18:43:53 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:43:53 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:43:53 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:43:53 user nova-compute[72810]:   </cpu>
Jul 31 18:43:53 user nova-compute[72810]:   <devices>
Jul 31 18:43:53 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:43:53 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:43:53 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk"/>
Jul 31 18:43:53 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:43:53 user nova-compute[72810]:     </disk>
Jul 31 18:43:53 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:43:53 user nova-compute[72810]:       <mac address="fa:16:3e:08:63:17"/>
Jul 31 18:43:53 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:53 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:43:53 user nova-compute[72810]:       <target dev="tap13e413db-6d"/>
Jul 31 18:43:53 user nova-compute[72810]:     </interface>
Jul 31 18:43:53 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:43:53 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/console.log" append="off"/>
Jul 31 18:43:53 user nova-compute[72810]:     </serial>
Jul 31 18:43:53 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:43:53 user nova-compute[72810]:     <video>
Jul 31 18:43:53 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:43:53 user nova-compute[72810]:     </video>
Jul 31 18:43:53 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:43:53 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:43:53 user nova-compute[72810]:     </rng>
Jul 31 18:43:53 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:43:53 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:43:53 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:43:53 user nova-compute[72810]:     </memballoon>
Jul 31 18:43:53 user nova-compute[72810]:   </devices>
Jul 31 18:43:53 user nova-compute[72810]: </domain>
Jul 31 18:43:53 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1682289298',display_name='tempest-TestVolumeSwap-server-1682289298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1682289298',id=17,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBctQYODPgd3GwLvxg6v6/tb21AD9RhadEzdK4HL86GGH90gv5zuQer5DfUCZAriopcL6N6FBXNqS7vdTExlYKfPetfpWa0THkwpNtAXcojqS++gyol8VfGWTehNkePNag==',key_name='tempest-keypair-2022165580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e21ca5b7ebc497cafb9af2f79cb6453',ramdisk_id='',reservation_id='r-c55x4f8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-993383493',owner_user_name='tempest-TestVolumeSwap-993383493-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae78538787b4a37990ba448a59dcb60',uuid=d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converting VIF {"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG os_vif [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13e413db-6d, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13e413db-6d, col_values=(('external_ids', {'iface-id': '13e413db-6d28-4650-acae-7cd364b74b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:63:17', 'vm-uuid': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:53 user nova-compute[72810]: INFO os_vif [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d')
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:43:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] No VIF found with MAC fa:16:3e:08:63:17, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-changed-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Refreshing instance network info cache due to event network-changed-13e413db-6d28-4650-acae-7cd364b74b2a. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Acquiring lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Acquired lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Refreshing network info cache for port 13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829034.49856, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Resumed (Lifecycle Event)
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:43:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance spawned successfully.
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829034.499992, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Started (Lifecycle Event)
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72810) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bb8265d7-e0cf-43bc-be29-3a034ac6dbea tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.110s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updated VIF entry in instance network info cache for port 13e413db-6d28-4650-acae-7cd364b74b2a. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating instance_info_cache with network_info: [{"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Releasing lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:55 user nova-compute[72810]: WARNING nova.compute.manager [req-18b9fdf9-7a7b-48ad-82de-a7d748e68cd0 req-abeb3271-6559-473d-999a-76cffbcee8a4 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 18:43:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] No waiting events found dispatching network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:56 user nova-compute[72810]: WARNING nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received unexpected event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a for instance with vm_state building and task_state spawning.
Jul 31 18:43:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] No waiting events found dispatching network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:43:56 user nova-compute[72810]: WARNING nova.compute.manager [req-cb45f7f2-8890-43e3-bb0a-0f041df0c40c req-a39e6670-e4da-43a2-b0c1-13a01394df5a service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received unexpected event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a for instance with vm_state building and task_state spawning.
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:43:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Creating image(s)
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Ensure instance console log exists: /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Start _get_guest_xml network_info=[{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQvUsBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd28d44a8-342f-49e6-b443-f86c755a13d1', 'attached_at': '', 'detached_at': '', 'volume_id': '0e2183bc-e621-41f1-bd84-cf5d586d8281', 'serial': '0e2183bc-e621-41f1-bd84-cf5d586d8281'}, 'attachment_id': '04912fae-64bc-4930-a476-1424e15e6a36', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSTEdLCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd28d44a8-342f-49e6-b443-f86c755a13d1', 'attached_at': '', 'detached_at': '', 'volume_id': '3b116e5b-6466-4bb5-af8a-444a5226a04e', 'serial': '3b116e5b-6466-4bb5-af8a-444a5226a04e'}, 'attachment_id': '982195e9-8987-4a11-ab02-2bdbb2666e69', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYGqLFmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd28d44a8-342f-49e6-b443-f86c755a13d1', 'attached_at': '', 'detached_at': '', 'volume_id': '11597ad3-9bdc-412b-99b9-7d714798c55b', 'serial': '11597ad3-9bdc-412b-99b9-7d714798c55b'}, 'attachment_id': 'f65a206e-b744-41d8-b143-c7bd2d2e0ea9', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:43:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQvUsBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:57 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:57 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:57 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7bc07-4658-4942-91bd-bf027f1f5dd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:57 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c3a5f-b0d0-46a6-b740-64be50620ca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281] added
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddec424f-1961-4e69-8c0c-b531cd9b0fdc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b3f43-e7b1-4694-9f5c-4281e113258f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqQvUsBu {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqQvUsBu" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbddfa7d-1f22-48d7-85b2-a95312d617c0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqQvUsBu'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a92c01-6469-467f-9f75-06b96e54819e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b6ed8a-7de5-44bb-8dd3-6f0afbb67fd3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --login" returned: 0 in 0.159s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa3573a-999c-481f-94eb-4bcdb99398a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260]
Jul 31 18:43:57 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760ef3e-2b7e-4d2b-85d7-931115aee5a1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e95d3b-1420-4e2e-b61b-21ab4010bb0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fd9022-122a-40ba-ac38-d274cdac7da6]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQvUsBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-07c465a5-f804-4285-8a34-a51996938d7d req-20c79735-a904-4dfd-8946-860f462012e0 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event volume-reimaged-ad023e56-151e-454f-bf0c-853c0fdc0601 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c465a5-f804-4285-8a34-a51996938d7d req-20c79735-a904-4dfd-8946-860f462012e0 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c465a5-f804-4285-8a34-a51996938d7d req-20c79735-a904-4dfd-8946-860f462012e0 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-07c465a5-f804-4285-8a34-a51996938d7d req-20c79735-a904-4dfd-8946-860f462012e0 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-07c465a5-f804-4285-8a34-a51996938d7d req-20c79735-a904-4dfd-8946-860f462012e0 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Processing event volume-reimaged-ad023e56-151e-454f-bf0c-853c0fdc0601 {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.virt.block_device [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Booting with volume ad023e56-151e-454f-bf0c-853c0fdc0601 at /dev/vda
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829038.5823298, d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] VM Resumed (Lifecycle Event)
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Instance spawned successfully.
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.utils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829038.5855649, d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] VM Started (Lifecycle Event)
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3812a2b-e87d-4b2a-91fd-c686b6a0f260]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[03253646-932a-4343-85cb-2aac164662e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b72fde2-763b-4711-ac88-04461d65ae11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941dc4f-41b2-4582-a771-e9e36031c7fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.623s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== connect_volume: return (1626ms) {'type': 'block', 'scsi_wwn': '23337613134303466', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337613134303466', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Took 8.27 seconds to spawn the instance on the hypervisor.
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:43:58 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896a73b-8a1e-4071-8a5d-4c605657a0be]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.utils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating existing volume attachment record: f966d245-2666-4d4b-954e-81f6de3f4ccf {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSTEdLCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:43:58 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:58 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:43:58 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4d15e8-5acd-4804-a1af-457664023c35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:43:58 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[90abcdd4-f5f7-487e-85e9-46b4362f9595]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e] added
Jul 31 18:43:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ae6fa6-2138-446b-95f3-d987982501e8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Took 9.81 seconds to build instance.
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[75872e56-94cc-45ac-b058-d24c0b7d73ad]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSTEdLCI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSTEdLCI" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e07015-c9f4-4d8e-a75a-95a3bfb4142f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSTEdLCI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed4be671-915d-4cf1-bdda-9087a1b8cc65 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.990s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8fda89-aa2f-42b3-9da9-c675ed68346d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ef7a57-a208-4a67-9b36-e97c7ec7675a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4efd712-9545-4523-8910-7f968b13078f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260]
Jul 31 18:43:59 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260] successful.
Jul 31 18:43:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.055s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f0e18-dc07-4ff2-94f4-31a8daec3d44]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87987642-b09e-4690-ad41-073a4d55e428]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:43:59 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:43:59 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e97d41-82d9-4f13-b3ea-9d48b426d2d8]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:43:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSTEdLCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '26537393463353665', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537393463353665', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYGqLFmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:44:00 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:00 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:00 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7257a01-681a-4cd7-9ab3-c7c341849543]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:44:00 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f736924-3873-4884-af2b-550b8088ebfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b] added
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c9615-cca7-4a9c-b557-68fe1ac114bc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[00232f22-a669-4a99-866a-385100047753]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYGqLFmP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NYGqLFmP" returned: 0 in 0.106s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e9960-2217-4231-9dba-85a2a28ef9b4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NYGqLFmP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2f878f-73cb-48be-aef5-862f9f11c054]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0910c8-1d6c-4b4d-abb8-8224bee6c12a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a6f19-d764-4b5d-9650-2c1b8187b555]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260]
Jul 31 18:44:00 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260] successful.
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5450db-5079-4fc7-af7f-5a5cdfaed766]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b98d72-a644-41e9-8d45-df7437c5ead8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:00 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.473s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.062s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836082d-d5bc-4808-8a61-786cf45d7ea9]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:00 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829026.3957927, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:01 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Stopped (Lifecycle Event)
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a310fa2a-12a3-4eb8-93aa-0e6923c5285f None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a310fa2a-12a3-4eb8-93aa-0e6923c5285f None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829026.4368043, 0ad2d315-6afe-4d01-98da-07d5c08548f7 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:01 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] VM Stopped (Lifecycle Event)
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3164fd3-edfc-414e-9b7e-abb5bd1b127d None None] [instance: 0ad2d315-6afe-4d01-98da-07d5c08548f7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:01 user nova-compute[72810]: INFO nova.compute.manager [None req-a310fa2a-12a3-4eb8-93aa-0e6923c5285f None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 18:44:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYGqLFmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.561s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== connect_volume: return (1563ms) {'type': 'block', 'scsi_wwn': '23934653032353237', 'path': '/dev/sdg'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:44:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934653032353237', 'path': '/dev/sdg'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lazy-loading 'pci_devices' on Instance uuid d28d44a8-342f-49e6-b443-f86c755a13d1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:02 user nova-compute[72810]:   <uuid>d28d44a8-342f-49e6-b443-f86c755a13d1</uuid>
Jul 31 18:44:02 user nova-compute[72810]:   <name>instance-00000010</name>
Jul 31 18:44:02 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:44:02 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:02 user nova-compute[72810]:   <metadata>
Jul 31 18:44:02 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:02 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:name>tempest-device-tagging-server-2079264601</nova:name>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:43:57</nova:creationTime>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:44:02 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:02 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:user uuid="3c7914ceb46d40609b917ecc20114a46">tempest-TaggedBootDevicesTest_v242-1439948650-project-member</nova:user>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:project uuid="e10f67d01e8b423caedc3d8d09e50fe1">tempest-TaggedBootDevicesTest_v242-1439948650</nova:project>
Jul 31 18:44:02 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:44:02 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="fbd39ed7-b0d3-417c-a097-8cd2e8db0932">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="e8aa4365-e127-46b7-b52f-37c4cfaaab04">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="33768b88-d2fc-4341-ab4f-a8bdedf6dbd8">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="8ac7e333-c36b-4d18-a588-ad617e30c871">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="f170bd35-f99d-49bf-9d67-c5b9e95df724">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="df8f2c14-1ccf-4821-83b5-b75bd7970bc1">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:         <nova:port uuid="90f1212f-f1af-4124-8604-c56b47069dd7">
Jul 31 18:44:02 user nova-compute[72810]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 18:44:02 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:02 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:02 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:02 user nova-compute[72810]:   </metadata>
Jul 31 18:44:02 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:02 user nova-compute[72810]:     <system>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="serial">d28d44a8-342f-49e6-b443-f86c755a13d1</entry>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="uuid">d28d44a8-342f-49e6-b443-f86c755a13d1</entry>
Jul 31 18:44:02 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:02 user nova-compute[72810]:     </system>
Jul 31 18:44:02 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:02 user nova-compute[72810]:   <os>
Jul 31 18:44:02 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:02 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:44:02 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:02 user nova-compute[72810]:   </os>
Jul 31 18:44:02 user nova-compute[72810]:   <features>
Jul 31 18:44:02 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:02 user nova-compute[72810]:     <apic/>
Jul 31 18:44:02 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:02 user nova-compute[72810]:   </features>
Jul 31 18:44:02 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:02 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:02 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:02 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:02 user nova-compute[72810]:   </clock>
Jul 31 18:44:02 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:02 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:02 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:02 user nova-compute[72810]:   </cpu>
Jul 31 18:44:02 user nova-compute[72810]:   <devices>
Jul 31 18:44:02 user nova-compute[72810]:     <disk type="file" device="cdrom">
Jul 31 18:44:02 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 18:44:02 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/disk.config"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="hda" bus="ide"/>
Jul 31 18:44:02 user nova-compute[72810]:     </disk>
Jul 31 18:44:02 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:44:02 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:02 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <serial>0e2183bc-e621-41f1-bd84-cf5d586d8281</serial>
Jul 31 18:44:02 user nova-compute[72810]:     </disk>
Jul 31 18:44:02 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:44:02 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:02 user nova-compute[72810]:       <source dev="/dev/sde"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <serial>3b116e5b-6466-4bb5-af8a-444a5226a04e</serial>
Jul 31 18:44:02 user nova-compute[72810]:     </disk>
Jul 31 18:44:02 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:44:02 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:02 user nova-compute[72810]:       <source dev="/dev/sdg"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="vdc" bus="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <serial>11597ad3-9bdc-412b-99b9-7d714798c55b</serial>
Jul 31 18:44:02 user nova-compute[72810]:     </disk>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:cd:19:d9"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tapfbd39ed7-b0"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:6d:b5:e5"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tape8aa4365-e1"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:c4:93:d0"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tap33768b88-d2"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:66:00:21"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tap8ac7e333-c3"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:3b:f5:5f"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tapf170bd35-f9"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:8b:77:12"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tapdf8f2c14-1c"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:02 user nova-compute[72810]:       <mac address="fa:16:3e:e6:2a:f6"/>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:02 user nova-compute[72810]:       <target dev="tap90f1212f-f1"/>
Jul 31 18:44:02 user nova-compute[72810]:     </interface>
Jul 31 18:44:02 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:02 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/console.log" append="off"/>
Jul 31 18:44:02 user nova-compute[72810]:     </serial>
Jul 31 18:44:02 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:02 user nova-compute[72810]:     <video>
Jul 31 18:44:02 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:02 user nova-compute[72810]:     </video>
Jul 31 18:44:02 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:02 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:02 user nova-compute[72810]:     </rng>
Jul 31 18:44:02 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:02 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:02 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:02 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:02 user nova-compute[72810]:   </devices>
Jul 31 18:44:02 user nova-compute[72810]: </domain>
Jul 31 18:44:02 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbd39ed7-b0, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbd39ed7-b0, col_values=(('external_ids', {'iface-id': 'fbd39ed7-b0d3-417c-a097-8cd2e8db0932', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:19:d9', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8aa4365-e1, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8aa4365-e1, col_values=(('external_ids', {'iface-id': 'e8aa4365-e127-46b7-b52f-37c4cfaaab04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:b5:e5', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Starting finish_migration {{(pid=72810) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:44:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Creating image(s)
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33768b88-d2, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33768b88-d2, col_values=(('external_ids', {'iface-id': '33768b88-d2fc-4341-ab4f-a8bdedf6dbd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:93:d0', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ac7e333-c3, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ac7e333-c3, col_values=(('external_ids', {'iface-id': '8ac7e333-c36b-4d18-a588-ad617e30c871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:00:21', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf170bd35-f9, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf170bd35-f9, col_values=(('external_ids', {'iface-id': 'f170bd35-f99d-49bf-9d67-c5b9e95df724', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:f5:5f', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk. size=21474836480 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf8f2c14-1c, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf8f2c14-1c, col_values=(('external_ids', {'iface-id': 'df8f2c14-1ccf-4821-83b5-b75bd7970bc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:77:12', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90f1212f-f1, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90f1212f-f1, col_values=(('external_ids', {'iface-id': '90f1212f-f1af-4124-8604-c56b47069dd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:2a:f6', 'vm-uuid': 'd28d44a8-342f-49e6-b443-f86c755a13d1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk 21474836480 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk 21474836480" returned: 0 in 0.065s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_vif [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1')
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Ensure instance console log exists: /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start _get_guest_xml network_info=[{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8dc56ab6-c880-4078-9bfb-4b2089655c9f', 'attached_at': '2023-07-31T18:44:02.000000', 'detached_at': '', 'volume_id': 'dc1ae67d-0e4b-44b6-b270-7370bede66d1', 'serial': 'dc1ae67d-0e4b-44b6-b270-7370bede66d1'}, 'attachment_id': '67637194-f490-489a-b6b1-d32f4fa809b9', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:44:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:44:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:02 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] No BDM found with device name hda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] No VIF found with MAC fa:16:3e:cd:19:d9, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] No VIF found with MAC fa:16:3e:3b:f5:5f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Using config drive
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55c5f8-efc4-4456-9f1b-3ea24f86819f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:44:02 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ced0b21-9f7c-4918-929d-2fa4c7ceeaba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added
Jul 31 18:44:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[70246dc7-8098-4600-83ed-a530deaeee31]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[983c7b3b-91b4-40a9-9907-26682429c0f8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[23db56a7-04ca-4c50-aee7-c907e656f084]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PsOniwBN'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14614f-3548-4ffe-94af-d38f95ab3eec]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59f39a-deb0-4b87-9e6c-4f170d219154]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Creating config drive at /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/disk.config
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp044xmbjl {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1d54d6-0b4f-4e7b-8811-690842fdf223]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:44:03 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:44:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp044xmbjl" returned: 0 in 0.075s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[902e3a2b-ae0b-4a97-ab76-6e1bcb45db31]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e471b9-4890-4846-b68c-92428f6aa57d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[09374b6d-5da7-46df-ac58-9816a810ac3f]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:44:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdh'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdh'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:04 user nova-compute[72810]:   <uuid>8dc56ab6-c880-4078-9bfb-4b2089655c9f</uuid>
Jul 31 18:44:04 user nova-compute[72810]:   <name>instance-00000006</name>
Jul 31 18:44:04 user nova-compute[72810]:   <memory>2097152</memory>
Jul 31 18:44:04 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:04 user nova-compute[72810]:   <metadata>
Jul 31 18:44:04 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:04 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherB-server-633726612</nova:name>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:44:02</nova:creationTime>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:flavor name="m1.small">
Jul 31 18:44:04 user nova-compute[72810]:         <nova:memory>2048</nova:memory>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:disk>20</nova:disk>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:04 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:user uuid="13def89025e84e98a4ed596c16e0d0ce">tempest-ServerActionsTestOtherB-275988675-project-member</nova:user>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:project uuid="1be7d23c4eb74c43a79711e7253b436c">tempest-ServerActionsTestOtherB-275988675</nova:project>
Jul 31 18:44:04 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:44:04 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:04 user nova-compute[72810]:         <nova:port uuid="8f869796-d849-427e-91fe-d54efcdb4674">
Jul 31 18:44:04 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:44:04 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:04 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:04 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:04 user nova-compute[72810]:   </metadata>
Jul 31 18:44:04 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:04 user nova-compute[72810]:     <system>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="serial">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="uuid">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:44:04 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:04 user nova-compute[72810]:     </system>
Jul 31 18:44:04 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:04 user nova-compute[72810]:   <os>
Jul 31 18:44:04 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:04 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:44:04 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:04 user nova-compute[72810]:   </os>
Jul 31 18:44:04 user nova-compute[72810]:   <features>
Jul 31 18:44:04 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:04 user nova-compute[72810]:     <apic/>
Jul 31 18:44:04 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:04 user nova-compute[72810]:   </features>
Jul 31 18:44:04 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:04 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:04 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:04 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:04 user nova-compute[72810]:   </clock>
Jul 31 18:44:04 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:04 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:04 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:04 user nova-compute[72810]:   </cpu>
Jul 31 18:44:04 user nova-compute[72810]:   <devices>
Jul 31 18:44:04 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:44:04 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:44:04 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk"/>
Jul 31 18:44:04 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:04 user nova-compute[72810]:     </disk>
Jul 31 18:44:04 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:44:04 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:04 user nova-compute[72810]:       <source dev="/dev/sdh"/>
Jul 31 18:44:04 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:44:04 user nova-compute[72810]:       <serial>dc1ae67d-0e4b-44b6-b270-7370bede66d1</serial>
Jul 31 18:44:04 user nova-compute[72810]:     </disk>
Jul 31 18:44:04 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:04 user nova-compute[72810]:       <mac address="fa:16:3e:04:7a:fa"/>
Jul 31 18:44:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:04 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:04 user nova-compute[72810]:       <target dev="tap8f869796-d8"/>
Jul 31 18:44:04 user nova-compute[72810]:     </interface>
Jul 31 18:44:04 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:04 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/console.log" append="off"/>
Jul 31 18:44:04 user nova-compute[72810]:     </serial>
Jul 31 18:44:04 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:04 user nova-compute[72810]:     <video>
Jul 31 18:44:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:04 user nova-compute[72810]:     </video>
Jul 31 18:44:04 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:04 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:04 user nova-compute[72810]:     </rng>
Jul 31 18:44:04 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:04 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:04 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:04 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:04 user nova-compute[72810]:   </devices>
Jul 31 18:44:04 user nova-compute[72810]: </domain>
Jul 31 18:44:04 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-626102637-network", "vif_mac": "fa:16:3e:04:7a:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG os_vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f869796-d8, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f869796-d8, col_values=(('external_ids', {'iface-id': '8f869796-d849-427e-91fe-d54efcdb4674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7a:fa', 'vm-uuid': '8dc56ab6-c880-4078-9bfb-4b2089655c9f'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:04 user nova-compute[72810]: INFO os_vif [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] No VIF found with MAC fa:16:3e:04:7a:fa, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:05 user nova-compute[72810]: WARNING nova.compute.manager [req-bc7b972f-58d8-42ab-84f2-f5324a17909e req-0a940543-2465-4c92-ad7f-af0c3c3678ce service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 for instance with vm_state building and task_state spawning.
Jul 31 18:44:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:07 user nova-compute[72810]: WARNING nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 for instance with vm_state building and task_state spawning.
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:07 user nova-compute[72810]: WARNING nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 for instance with vm_state building and task_state spawning.
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:07 user nova-compute[72810]: WARNING nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 for instance with vm_state building and task_state spawning.
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:07 user nova-compute[72810]: WARNING nova.compute.manager [req-70f2db33-e746-4e4d-9734-92b31cc34107 req-23e7d3a2-520d-45e9-b049-b721af1743e7 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 for instance with vm_state building and task_state spawning.
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:08 user nova-compute[72810]: WARNING nova.compute.manager [req-8a52698c-d698-469c-b529-cc5c55f0a955 req-af156679-e1e0-4f60-94ee-1ba22e0213e3 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 for instance with vm_state building and task_state spawning.
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:08 user nova-compute[72810]: WARNING nova.compute.manager [req-32c2aed9-6099-4e70-80db-28486c5ad6ca req-48201453-247f-412b-b1b3-bce1f5317415 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 for instance with vm_state building and task_state spawning.
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:44:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Creating image(s)
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Ensure instance console log exists: /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start _get_guest_xml network_info=[{"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d690479-e8ce-427c-8008-daaf4ed124b1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad023e56-151e-454f-bf0c-853c0fdc0601', 'serial': 'ad023e56-151e-454f-bf0c-853c0fdc0601'}, 'attachment_id': 'f966d245-2666-4d4b-954e-81f6de3f4ccf', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 18:44:09 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:44:09 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:09 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:09 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9db3bc9-f654-46dd-8e3d-215a2dca943f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:44:09 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[65856867-fcd2-46c4-bf02-3711ec3a5afc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601] added
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4dd6e-d2d0-46c3-9dc0-1d8af0297d43]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f5216d-4fbb-4b7d-8e6e-b712c1940297]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKiZksLh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OKiZksLh" returned: 0 in 0.081s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16143a-132f-4f3f-99ee-3329b6b412bc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OKiZksLh'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a3a8f-aa4f-4dd6-842d-ebae1f9c0cb4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb25a1-d4fc-4242-83fc-6adfa2ee5564]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[716b8183-acd0-47a0-931d-784a3e231c6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]
Jul 31 18:44:09 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ae63d-098a-496e-8493-bffe50814a17]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4ad9f-a995-415d-99c5-03b575051d9d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.527s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:44:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:10 user nova-compute[72810]: WARNING nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 for instance with vm_state building and task_state spawning.
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:10 user nova-compute[72810]: WARNING nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state active and task_state resize_finish.
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:10 user nova-compute[72810]: WARNING nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state active and task_state resize_finish.
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:10 user nova-compute[72810]: WARNING nova.compute.manager [req-21da03bf-0900-4830-a9a5-e974ff8866ec req-54ddce1c-baaf-4c6f-98e5-780c586bb1b2 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 for instance with vm_state building and task_state spawning.
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.050s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac4345-042b-49f5-a091-c81a7b560010]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:10 user nova-compute[72810]: WARNING nova.compute.manager [req-286469fb-1556-4f07-b1bc-b2d05bb58505 req-0b339ab7-8345-443c-973d-4c07fabaeb18 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 for instance with vm_state building and task_state spawning.
Jul 31 18:44:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:11 user nova-compute[72810]: WARNING nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 for instance with vm_state building and task_state spawning.
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:11 user nova-compute[72810]: WARNING nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 for instance with vm_state building and task_state spawning.
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:11 user nova-compute[72810]: WARNING nova.compute.manager [req-acca2802-84e6-4315-b999-59b31b2878e2 req-2edcabc6-ed62-4d02-ba93-cb2d84525cbe service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 for instance with vm_state building and task_state spawning.
Jul 31 18:44:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.640s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== connect_volume: return (1643ms) {'type': 'block', 'scsi_wwn': '26533323830306538', 'path': '/dev/sdi'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533323830306538', 'path': '/dev/sdi'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-888682122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:11 user nova-compute[72810]:   <uuid>1d690479-e8ce-427c-8008-daaf4ed124b1</uuid>
Jul 31 18:44:11 user nova-compute[72810]:   <name>instance-0000000d</name>
Jul 31 18:44:11 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:44:11 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:11 user nova-compute[72810]:   <metadata>
Jul 31 18:44:11 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:11 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:11 user nova-compute[72810]:       <nova:name>tempest-ServerActionsV293TestJSON-server-888682122</nova:name>
Jul 31 18:44:11 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:44:09</nova:creationTime>
Jul 31 18:44:11 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:44:11 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:11 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:11 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:user uuid="b274199e036644afba90b84bd12b0f5b">tempest-ServerActionsV293TestJSON-373314597-project-member</nova:user>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:project uuid="1cb070b24ed34fb6b3f310d3fae39942">tempest-ServerActionsV293TestJSON-373314597</nova:project>
Jul 31 18:44:11 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:11 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:11 user nova-compute[72810]:         <nova:port uuid="df39a498-a56b-4dba-94c7-0faccbc50443">
Jul 31 18:44:11 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 18:44:11 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:11 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:11 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:11 user nova-compute[72810]:   </metadata>
Jul 31 18:44:11 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:11 user nova-compute[72810]:     <system>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="serial">1d690479-e8ce-427c-8008-daaf4ed124b1</entry>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="uuid">1d690479-e8ce-427c-8008-daaf4ed124b1</entry>
Jul 31 18:44:11 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:11 user nova-compute[72810]:     </system>
Jul 31 18:44:11 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:11 user nova-compute[72810]:   <os>
Jul 31 18:44:11 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:11 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:44:11 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:11 user nova-compute[72810]:   </os>
Jul 31 18:44:11 user nova-compute[72810]:   <features>
Jul 31 18:44:11 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:11 user nova-compute[72810]:     <apic/>
Jul 31 18:44:11 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:11 user nova-compute[72810]:   </features>
Jul 31 18:44:11 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:11 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:11 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:11 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:11 user nova-compute[72810]:   </clock>
Jul 31 18:44:11 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:11 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:11 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:11 user nova-compute[72810]:   </cpu>
Jul 31 18:44:11 user nova-compute[72810]:   <devices>
Jul 31 18:44:11 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:44:11 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:11 user nova-compute[72810]:       <source dev="/dev/sdi"/>
Jul 31 18:44:11 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:11 user nova-compute[72810]:       <serial>ad023e56-151e-454f-bf0c-853c0fdc0601</serial>
Jul 31 18:44:11 user nova-compute[72810]:     </disk>
Jul 31 18:44:11 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:11 user nova-compute[72810]:       <mac address="fa:16:3e:7a:4a:9f"/>
Jul 31 18:44:11 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:11 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:11 user nova-compute[72810]:       <target dev="tapdf39a498-a5"/>
Jul 31 18:44:11 user nova-compute[72810]:     </interface>
Jul 31 18:44:11 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:11 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1/console.log" append="off"/>
Jul 31 18:44:11 user nova-compute[72810]:     </serial>
Jul 31 18:44:11 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:11 user nova-compute[72810]:     <video>
Jul 31 18:44:11 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:11 user nova-compute[72810]:     </video>
Jul 31 18:44:11 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:11 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:11 user nova-compute[72810]:     </rng>
Jul 31 18:44:11 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:11 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:11 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:11 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:11 user nova-compute[72810]:   </devices>
Jul 31 18:44:11 user nova-compute[72810]: </domain>
Jul 31 18:44:11 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-888682122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG os_vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf39a498-a5, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf39a498-a5, col_values=(('external_ids', {'iface-id': 'df39a498-a56b-4dba-94c7-0faccbc50443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:4a:9f', 'vm-uuid': '1d690479-e8ce-427c-8008-daaf4ed124b1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: INFO os_vif [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5')
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] No VIF found with MAC fa:16:3e:7a:4a:9f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:11 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829052.1114373, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Resumed (Lifecycle Event)
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance running successfully.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Failed to set time: agent not configured {{(pid=72810) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-35f414a7-8658-456d-a137-d16f40d15bdd tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] finish_migration finished successfully. {{(pid=72810) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:12 user nova-compute[72810]: WARNING nova.compute.manager [req-15805233-2baf-4e86-bbd5-7e17da6d55f8 req-d432fa7e-c945-4377-bcfd-7c82d226cbc0 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 for instance with vm_state building and task_state spawning.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829052.1148744, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Started (Lifecycle Event)
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829052.5289154, d28d44a8-342f-49e6-b443-f86c755a13d1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] VM Resumed (Lifecycle Event)
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance spawned successfully.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829052.5335143, d28d44a8-342f-49e6-b443-f86c755a13d1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] VM Started (Lifecycle Event)
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Took 15.67 seconds to spawn the instance on the hypervisor.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:12 user nova-compute[72810]: INFO nova.compute.manager [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Took 56.12 seconds to build instance.
Jul 31 18:44:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-620caf86-9ee9-4c91-9136-f557ad74e246 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.339s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:13 user nova-compute[72810]: WARNING nova.compute.manager [req-40ed39dc-be15-4f1c-ad89-fd280d4a7fe6 req-63005867-8642-433c-bbde-d6abf3b75bd5 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 18:44:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:13 user nova-compute[72810]: INFO nova.compute.manager [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Rescuing
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:15 user nova-compute[72810]: WARNING nova.compute.manager [req-2587b077-06a4-48d1-827e-01da0d43038a req-8492f58e-32fa-4221-aae4-f1ccb9d7eec8 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance destroyed successfully.
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.553s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829056.599146, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:16 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Resumed (Lifecycle Event)
Jul 31 18:44:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Attempting rescue
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:44:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Creating image(s)
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.047s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'trusted_certs' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance spawned successfully.
Jul 31 18:44:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.103s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:17 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829056.6854863, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:17 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Started (Lifecycle Event)
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.287s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue" returned: 0 in 0.075s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.367s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:17 user nova-compute[72810]: WARNING nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state rescuing.
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:17 user nova-compute[72810]: WARNING nova.compute.manager [req-9362d15e-c206-41d4-9ecd-5cd33631d852 req-4545e0b4-9b7e-4ff0-ad83-fbeba2fb5dd1 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state rescuing.
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start _get_guest_xml network_info=[{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:2a:f7:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'numa_topology' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:17 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 18:44:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'vcpu_model' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2023309342',display_name='tempest-ServerRescueNegativeTestJSON-server-2023309342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2023309342',id=3,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-dzqw94br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:39:47Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=d138fb7b-7969-4099-8e54-dfd892738660,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:2a:f7:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:2a:f7:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:17 user nova-compute[72810]:   <uuid>d138fb7b-7969-4099-8e54-dfd892738660</uuid>
Jul 31 18:44:17 user nova-compute[72810]:   <name>instance-00000003</name>
Jul 31 18:44:17 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:44:17 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:17 user nova-compute[72810]:   <metadata>
Jul 31 18:44:17 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:17 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2023309342</nova:name>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:44:17</nova:creationTime>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:44:17 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:17 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:44:17 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:44:17 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:17 user nova-compute[72810]:         <nova:port uuid="d26e6cf1-fb0d-4592-bd29-d26190c47b99">
Jul 31 18:44:17 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 18:44:17 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:17 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:17 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:17 user nova-compute[72810]:   </metadata>
Jul 31 18:44:17 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:17 user nova-compute[72810]:     <system>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="serial">d138fb7b-7969-4099-8e54-dfd892738660</entry>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="uuid">d138fb7b-7969-4099-8e54-dfd892738660</entry>
Jul 31 18:44:17 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:17 user nova-compute[72810]:     </system>
Jul 31 18:44:17 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:17 user nova-compute[72810]:   <os>
Jul 31 18:44:17 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:17 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:17 user nova-compute[72810]:   </os>
Jul 31 18:44:17 user nova-compute[72810]:   <features>
Jul 31 18:44:17 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:17 user nova-compute[72810]:     <apic/>
Jul 31 18:44:17 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:17 user nova-compute[72810]:   </features>
Jul 31 18:44:17 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:17 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:17 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:17 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:17 user nova-compute[72810]:   </clock>
Jul 31 18:44:17 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:17 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:17 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:17 user nova-compute[72810]:   </cpu>
Jul 31 18:44:17 user nova-compute[72810]:   <devices>
Jul 31 18:44:17 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:44:17 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:44:17 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue"/>
Jul 31 18:44:17 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:17 user nova-compute[72810]:     </disk>
Jul 31 18:44:17 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:44:17 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:44:17 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk"/>
Jul 31 18:44:17 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:44:17 user nova-compute[72810]:     </disk>
Jul 31 18:44:17 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:17 user nova-compute[72810]:       <mac address="fa:16:3e:2a:f7:ad"/>
Jul 31 18:44:17 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:17 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:17 user nova-compute[72810]:       <target dev="tapd26e6cf1-fb"/>
Jul 31 18:44:17 user nova-compute[72810]:     </interface>
Jul 31 18:44:17 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:17 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/console.log" append="off"/>
Jul 31 18:44:17 user nova-compute[72810]:     </serial>
Jul 31 18:44:17 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:17 user nova-compute[72810]:     <video>
Jul 31 18:44:17 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:17 user nova-compute[72810]:     </video>
Jul 31 18:44:17 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:17 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:17 user nova-compute[72810]:     </rng>
Jul 31 18:44:17 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:17 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:17 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:17 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:17 user nova-compute[72810]:   </devices>
Jul 31 18:44:17 user nova-compute[72810]: </domain>
Jul 31 18:44:17 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72810) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 18:44:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance destroyed successfully.
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:2a:f7:ad, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-07c465a5-f804-4285-8a34-a51996938d7d tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.166s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:44:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:23 user nova-compute[72810]: WARNING nova.compute.manager [req-1d6220c3-dc70-4a1f-9efd-b9f026412d95 req-d2637585-9b18-419a-906b-7aa27dd04c3a service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state rescuing.
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:23 user nova-compute[72810]: WARNING nova.compute.manager [req-6d933cd1-4f1a-4a69-9036-c1e49ff528ab req-99c92b9e-12fd-4aa5-b39a-05f7eb3b0be2 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state rescuing.
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for d138fb7b-7969-4099-8e54-dfd892738660 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829062.4808085, d138fb7b-7969-4099-8e54-dfd892738660 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:23 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Resumed (Lifecycle Event)
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-95f18ca5-206b-4454-9358-cabd0e8497c5 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7085MB free_disk=25.581775665283203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:23 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829062.4812214, d138fb7b-7969-4099-8e54-dfd892738660 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:23 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Started (Lifecycle Event)
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Applying migration context for instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f as it has an incoming, in-progress migration 28747608-e0df-4b68-b69b-85dc851a090d. Migration status is finished {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 18:44:23 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating resource usage from migration 28747608-e0df-4b68-b69b-85dc851a090d
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1d690479-e8ce-427c-8008-daaf4ed124b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 53ae5870-b8c6-4700-9ec7-a2671c01f44f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d28d44a8-342f-49e6-b443-f86c755a13d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Migration 28747608-e0df-4b68-b69b-85dc851a090d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:44:23 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:44:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:44:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.868s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:44:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:44:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:44:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:37 user nova-compute[72810]: INFO nova.compute.manager [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Detaching volume 62474fcc-2fa5-41ff-8d28-2076b8bde451
Jul 31 18:44:37 user nova-compute[72810]: INFO nova.virt.block_device [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Attempting to driver detach volume 62474fcc-2fa5-41ff-8d28-2076b8bde451 from mountpoint /dev/vdb
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Attempting to detach device vdb from instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:44:37 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:37 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:44:37 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:44:37 user nova-compute[72810]:   <serial>62474fcc-2fa5-41ff-8d28-2076b8bde451</serial>
Jul 31 18:44:37 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:44:37 user nova-compute[72810]: </disk>
Jul 31 18:44:37 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:44:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 from the persistent domain config.
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:44:37 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:44:37 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:44:37 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:44:37 user nova-compute[72810]:   <serial>62474fcc-2fa5-41ff-8d28-2076b8bde451</serial>
Jul 31 18:44:37 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:44:37 user nova-compute[72810]: </disk>
Jul 31 18:44:37 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829077.9386141, 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:44:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 from the live domain config.
Jul 31 18:44:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKbHQcov', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:44:37 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:44:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cd81ab-dd77-4e34-bb14-83eb387bd208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[662b892c-329a-40ee-afec-ba80459e9216]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 (non-flash)
Jul 31 18:44:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc425510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451'): ({'sdf'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Removing single pathed devices sdf {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[26343465-5ddb-400c-a03f-095fcdd5d2f3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52aac5-fe5b-401e-88ec-390944e05516]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flushing IO for device /dev/sdf {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809e995-68d7-4893-9194-79c5a2c2f6e1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2bbf3-df8e-4e24-9e25-ba41dde417f2]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.131s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d5c459-927a-40de-bb14-ef23c773bfde]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --logout" returned: 0 in 0.195s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424e596-ac79-41b8-8bd7-48cb11d4e1fa]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260]
Jul 31 18:44:38 user nova-compute[72810]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451, portal: 172.16.0.220,3260] successful.
Jul 31 18:44:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62474fcc-2fa5-41ff-8d28-2076b8bde451 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.105s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3119de9a-5126-43f9-8c32-fe58ded356c7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.640s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== disconnect_volume: return (641ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:44:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:44:39 user nova-compute[72810]: INFO nova.compute.claims [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Claim successful on node user
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d1ce10d5-58f8-40c1-87b5-b665158773db tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.568s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:44:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:44:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.policy [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef3882653e7244108f590048754d86b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb86a791f5464179b055746ede494239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:44:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Creating image(s)
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "/opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk 1073741824" returned: 0 in 0.097s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Cannot resize image /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'migration_context' on Instance uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Ensure instance console log exists: /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Successfully created port: 10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Successfully updated port: 10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-changed-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Refreshing instance network info cache due to event network-changed-10549b62-094e-4435-ad44-98ed4f356d4d. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] Acquiring lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:44:42 user nova-compute[72810]: INFO nova.compute.claims [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Claim successful on node user
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Instance network_info: |[{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] Acquired lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Refreshing network info cache for port 10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Start _get_guest_xml network_info=[{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:44:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008392714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008392714',id=18,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-g0i3i1m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:44:40Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=b65fe899-461a-44ca-85eb-8fdd33ffee9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:42 user nova-compute[72810]:   <uuid>b65fe899-461a-44ca-85eb-8fdd33ffee9d</uuid>
Jul 31 18:44:42 user nova-compute[72810]:   <name>instance-00000012</name>
Jul 31 18:44:42 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:44:42 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:42 user nova-compute[72810]:   <metadata>
Jul 31 18:44:42 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:42 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1008392714</nova:name>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:44:42</nova:creationTime>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:44:42 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:42 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:44:42 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:44:42 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:42 user nova-compute[72810]:         <nova:port uuid="10549b62-094e-4435-ad44-98ed4f356d4d">
Jul 31 18:44:42 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 18:44:42 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:42 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:42 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:42 user nova-compute[72810]:   </metadata>
Jul 31 18:44:42 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:42 user nova-compute[72810]:     <system>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="serial">b65fe899-461a-44ca-85eb-8fdd33ffee9d</entry>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="uuid">b65fe899-461a-44ca-85eb-8fdd33ffee9d</entry>
Jul 31 18:44:42 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:42 user nova-compute[72810]:     </system>
Jul 31 18:44:42 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:42 user nova-compute[72810]:   <os>
Jul 31 18:44:42 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:42 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:44:42 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:42 user nova-compute[72810]:   </os>
Jul 31 18:44:42 user nova-compute[72810]:   <features>
Jul 31 18:44:42 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:42 user nova-compute[72810]:     <apic/>
Jul 31 18:44:42 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:42 user nova-compute[72810]:   </features>
Jul 31 18:44:42 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:42 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:42 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:42 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:42 user nova-compute[72810]:   </clock>
Jul 31 18:44:42 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:42 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:42 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:42 user nova-compute[72810]:   </cpu>
Jul 31 18:44:42 user nova-compute[72810]:   <devices>
Jul 31 18:44:42 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:44:42 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:44:42 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk"/>
Jul 31 18:44:42 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:42 user nova-compute[72810]:     </disk>
Jul 31 18:44:42 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:42 user nova-compute[72810]:       <mac address="fa:16:3e:8a:48:02"/>
Jul 31 18:44:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:42 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:42 user nova-compute[72810]:       <target dev="tap10549b62-09"/>
Jul 31 18:44:42 user nova-compute[72810]:     </interface>
Jul 31 18:44:42 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:42 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/console.log" append="off"/>
Jul 31 18:44:42 user nova-compute[72810]:     </serial>
Jul 31 18:44:42 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:42 user nova-compute[72810]:     <video>
Jul 31 18:44:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:42 user nova-compute[72810]:     </video>
Jul 31 18:44:42 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:42 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:42 user nova-compute[72810]:     </rng>
Jul 31 18:44:42 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:42 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:42 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:42 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:42 user nova-compute[72810]:   </devices>
Jul 31 18:44:42 user nova-compute[72810]: </domain>
Jul 31 18:44:42 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008392714',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008392714',id=18,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-g0i3i1m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:44:40Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=b65fe899-461a-44ca-85eb-8fdd33ffee9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG os_vif [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10549b62-09, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10549b62-09, col_values=(('external_ids', {'iface-id': '10549b62-094e-4435-ad44-98ed4f356d4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:48:02', 'vm-uuid': 'b65fe899-461a-44ca-85eb-8fdd33ffee9d'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:42 user nova-compute[72810]: INFO os_vif [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09')
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:8a:48:02, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:44:42 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updated VIF entry in instance network info cache for port 10549b62-094e-4435-ad44-98ed4f356d4d. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022f9a9e-f44e-4893-a51a-de5bc90809d0 req-f5baa882-9f14-4b1d-8cce-4343013a6915 service nova] Releasing lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.policy [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26d1d9f9b9f843beb3359f1d43b7b4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d5a317bf9243e48b85a0a0633f72d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:44:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Creating image(s)
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "/opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "/opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "/opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk 1073741824" returned: 0 in 0.058s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Cannot resize image /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'migration_context' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Ensure instance console log exists: /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:43 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Successfully created port: 813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] No waiting events found dispatching network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:44 user nova-compute[72810]: WARNING nova.compute.manager [req-92711688-3c97-4a4b-896b-bdadf021d3f6 req-a4d9806a-d266-4743-9225-9228bbc606a3 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received unexpected event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d for instance with vm_state building and task_state spawning.
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Successfully updated port: 813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:44:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquired lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:44:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating instance_info_cache with network_info: [{"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Releasing lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Instance network_info: |[{"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Start _get_guest_xml network_info=[{"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:44:46 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:46 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269870268',display_name='tempest-VolumesSnapshotTestJSON-instance-269870268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269870268',id=19,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBd2x4WQcjYAvOs2zDJUzKs8hAGwCBdrdmTzKq8sXBHV7Ij2boEdNvq7TWx2gdVu813w39bPoBUZavtYXTW0QvGzP8Xg5d/PuadRitcKTDNDOcy6snwTWdRFrZCia60Tw==',key_name='tempest-keypair-1921662516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-g40jfohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=7366d84b-c5a4-4dbb-94b1-e8001a92655e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'pci_devices' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:44:46 user nova-compute[72810]:   <uuid>7366d84b-c5a4-4dbb-94b1-e8001a92655e</uuid>
Jul 31 18:44:46 user nova-compute[72810]:   <name>instance-00000013</name>
Jul 31 18:44:46 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:44:46 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:44:46 user nova-compute[72810]:   <metadata>
Jul 31 18:44:46 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:44:46 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-269870268</nova:name>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:44:46</nova:creationTime>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:44:46 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:44:46 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:owner>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:user uuid="26d1d9f9b9f843beb3359f1d43b7b4e8">tempest-VolumesSnapshotTestJSON-1152708704-project-member</nova:user>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:project uuid="70d5a317bf9243e48b85a0a0633f72d8">tempest-VolumesSnapshotTestJSON-1152708704</nova:project>
Jul 31 18:44:46 user nova-compute[72810]:       </nova:owner>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:44:46 user nova-compute[72810]:       <nova:ports>
Jul 31 18:44:46 user nova-compute[72810]:         <nova:port uuid="813ae1b1-e492-4ba2-b8a7-798790b9bafd">
Jul 31 18:44:46 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 18:44:46 user nova-compute[72810]:         </nova:port>
Jul 31 18:44:46 user nova-compute[72810]:       </nova:ports>
Jul 31 18:44:46 user nova-compute[72810]:     </nova:instance>
Jul 31 18:44:46 user nova-compute[72810]:   </metadata>
Jul 31 18:44:46 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:44:46 user nova-compute[72810]:     <system>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="serial">7366d84b-c5a4-4dbb-94b1-e8001a92655e</entry>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="uuid">7366d84b-c5a4-4dbb-94b1-e8001a92655e</entry>
Jul 31 18:44:46 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:44:46 user nova-compute[72810]:     </system>
Jul 31 18:44:46 user nova-compute[72810]:   </sysinfo>
Jul 31 18:44:46 user nova-compute[72810]:   <os>
Jul 31 18:44:46 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:44:46 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:44:46 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:44:46 user nova-compute[72810]:   </os>
Jul 31 18:44:46 user nova-compute[72810]:   <features>
Jul 31 18:44:46 user nova-compute[72810]:     <acpi/>
Jul 31 18:44:46 user nova-compute[72810]:     <apic/>
Jul 31 18:44:46 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:44:46 user nova-compute[72810]:   </features>
Jul 31 18:44:46 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:44:46 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:44:46 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:44:46 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:44:46 user nova-compute[72810]:   </clock>
Jul 31 18:44:46 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:44:46 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:44:46 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:44:46 user nova-compute[72810]:   </cpu>
Jul 31 18:44:46 user nova-compute[72810]:   <devices>
Jul 31 18:44:46 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:44:46 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:44:46 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk"/>
Jul 31 18:44:46 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:44:46 user nova-compute[72810]:     </disk>
Jul 31 18:44:46 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:44:46 user nova-compute[72810]:       <mac address="fa:16:3e:e4:42:c5"/>
Jul 31 18:44:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:46 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:44:46 user nova-compute[72810]:       <target dev="tap813ae1b1-e4"/>
Jul 31 18:44:46 user nova-compute[72810]:     </interface>
Jul 31 18:44:46 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:44:46 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/console.log" append="off"/>
Jul 31 18:44:46 user nova-compute[72810]:     </serial>
Jul 31 18:44:46 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:44:46 user nova-compute[72810]:     <video>
Jul 31 18:44:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:44:46 user nova-compute[72810]:     </video>
Jul 31 18:44:46 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:44:46 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:44:46 user nova-compute[72810]:     </rng>
Jul 31 18:44:46 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:44:46 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:44:46 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:44:46 user nova-compute[72810]:     </memballoon>
Jul 31 18:44:46 user nova-compute[72810]:   </devices>
Jul 31 18:44:46 user nova-compute[72810]: </domain>
Jul 31 18:44:46 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269870268',display_name='tempest-VolumesSnapshotTestJSON-instance-269870268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269870268',id=19,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBd2x4WQcjYAvOs2zDJUzKs8hAGwCBdrdmTzKq8sXBHV7Ij2boEdNvq7TWx2gdVu813w39bPoBUZavtYXTW0QvGzP8Xg5d/PuadRitcKTDNDOcy6snwTWdRFrZCia60Tw==',key_name='tempest-keypair-1921662516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-g40jfohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=7366d84b-c5a4-4dbb-94b1-e8001a92655e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG os_vif [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap813ae1b1-e4, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap813ae1b1-e4, col_values=(('external_ids', {'iface-id': '813ae1b1-e492-4ba2-b8a7-798790b9bafd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:42:c5', 'vm-uuid': '7366d84b-c5a4-4dbb-94b1-e8001a92655e'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:46 user nova-compute[72810]: INFO os_vif [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4')
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No VIF found with MAC fa:16:3e:e4:42:c5, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829086.3784082, b65fe899-461a-44ca-85eb-8fdd33ffee9d => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] VM Resumed (Lifecycle Event)
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Instance spawned successfully.
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829086.3804092, b65fe899-461a-44ca-85eb-8fdd33ffee9d => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] VM Started (Lifecycle Event)
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Took 6.43 seconds to spawn the instance on the hypervisor.
Jul 31 18:44:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:46 user nova-compute[72810]: INFO nova.compute.manager [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Took 7.72 seconds to build instance.
Jul 31 18:44:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6791dd14-5c9f-481d-b0db-a42687d9f0ca tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.829s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] No waiting events found dispatching network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:47 user nova-compute[72810]: WARNING nova.compute.manager [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received unexpected event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d for instance with vm_state active and task_state None.
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-changed-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Refreshing instance network info cache due to event network-changed-813ae1b1-e492-4ba2-b8a7-798790b9bafd. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Acquiring lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Acquired lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Refreshing network info cache for port 813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updated VIF entry in instance network info cache for port 813ae1b1-e492-4ba2-b8a7-798790b9bafd. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating instance_info_cache with network_info: [{"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5e2e923b-5078-48a1-9dd5-1f64d86e48cc req-53b9c5e5-aa23-4bf0-bfa0-425006775ab2 service nova] Releasing lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] No waiting events found dispatching network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:48 user nova-compute[72810]: WARNING nova.compute.manager [req-df08da43-4ace-4a95-b783-d8646d7ac1e8 req-92def018-59b4-4bc4-964a-0088e43190b5 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received unexpected event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd for instance with vm_state building and task_state spawning.
Jul 31 18:44:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829090.1904826, 7366d84b-c5a4-4dbb-94b1-e8001a92655e => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] VM Resumed (Lifecycle Event)
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Instance spawned successfully.
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829090.1949468, 7366d84b-c5a4-4dbb-94b1-e8001a92655e => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] VM Started (Lifecycle Event)
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Took 7.09 seconds to spawn the instance on the hypervisor.
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:44:50 user nova-compute[72810]: INFO nova.compute.manager [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Took 8.10 seconds to build instance.
Jul 31 18:44:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71b21e7d-5d50-4879-b77c-e64665b0c133 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.241s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] No waiting events found dispatching network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:50 user nova-compute[72810]: WARNING nova.compute.manager [req-f872a185-cee8-4091-a940-6e3b561e232e req-49e30f61-18b1-43f6-b083-dd6c25fc680a service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received unexpected event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd for instance with vm_state active and task_state None.
Jul 31 18:44:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:58 user nova-compute[72810]: INFO nova.compute.manager [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Terminating instance
Jul 31 18:44:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-unplugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] No waiting events found dispatching network-vif-unplugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-f62228d9-37c0-4911-a635-a800e512a1c9 req-1bb466ed-bbbb-4b4f-9608-6ccb0ad70cda service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-unplugged-072cc23f-009a-43bf-b06b-71877c1a13a4 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Instance destroyed successfully.
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'resources' on Instance uuid 53ae5870-b8c6-4700-9ec7-a2671c01f44f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:42:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1346849437',display_name='tempest-VolumesAdminNegativeTest-server-1346849437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1346849437',id=15,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:43:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-asvyk8w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:43:08Z,user_data=None,user_id='fd457df295124730b399dbd1fbed9d94',uuid=53ae5870-b8c6-4700-9ec7-a2671c01f44f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "072cc23f-009a-43bf-b06b-71877c1a13a4", "address": "fa:16:3e:4a:07:4f", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap072cc23f-00", "ovs_interfaceid": "072cc23f-009a-43bf-b06b-71877c1a13a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG os_vif [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap072cc23f-00, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:44:59 user nova-compute[72810]: INFO os_vif [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:07:4f,bridge_name='br-int',has_traffic_filtering=True,id=072cc23f-009a-43bf-b06b-71877c1a13a4,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap072cc23f-00')
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Deleting instance files /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f_del
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Deletion of /opt/stack/data/nova/instances/53ae5870-b8c6-4700-9ec7-a2671c01f44f_del complete
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.compute.manager [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Took 0.80 seconds to destroy the instance on the hypervisor.
Jul 31 18:44:59 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Took 0.63 seconds to deallocate network for instance.
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-6e3b4e93-4a95-4540-a953-5114ba80bb06 req-c57e3a32-93f4-416d-9a46-13544900860b service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-deleted-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:44:59 user nova-compute[72810]: INFO nova.compute.manager [req-6e3b4e93-4a95-4540-a953-5114ba80bb06 req-c57e3a32-93f4-416d-9a46-13544900860b service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Neutron deleted interface 072cc23f-009a-43bf-b06b-71877c1a13a4; detaching it from the instance and deleting it from the info cache
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.network.neutron [req-6e3b4e93-4a95-4540-a953-5114ba80bb06 req-c57e3a32-93f4-416d-9a46-13544900860b service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-6e3b4e93-4a95-4540-a953-5114ba80bb06 req-c57e3a32-93f4-416d-9a46-13544900860b service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Detach interface failed, port_id=072cc23f-009a-43bf-b06b-71877c1a13a4, reason: Instance 53ae5870-b8c6-4700-9ec7-a2671c01f44f could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:44:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:00 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Deleted allocations for instance 53ae5870-b8c6-4700-9ec7-a2671c01f44f
Jul 31 18:45:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0b565fce-5854-45e1-a5c5-49d1ab7cc657 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] Acquiring lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] Lock "53ae5870-b8c6-4700-9ec7-a2671c01f44f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] No waiting events found dispatching network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:00 user nova-compute[72810]: WARNING nova.compute.manager [req-0a696451-284e-4106-a93a-68d79ce618fd req-c47c7a8c-f13d-429f-b40b-38df7fead812 service nova] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Received unexpected event network-vif-plugged-072cc23f-009a-43bf-b06b-71877c1a13a4 for instance with vm_state deleted and task_state None.
Jul 31 18:45:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 18:45:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829099.0184772, 53ae5870-b8c6-4700-9ec7-a2671c01f44f => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:14 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] VM Stopped (Lifecycle Event)
Jul 31 18:45:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-734f61db-82d8-44ef-92a6-c179539c20f8 None None] [instance: 53ae5870-b8c6-4700-9ec7-a2671c01f44f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:45:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=6503MB free_disk=25.509552001953125GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Applying migration context for instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f as it has an incoming, in-progress migration 28747608-e0df-4b68-b69b-85dc851a090d. Migration status is finished {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 18:45:17 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating resource usage from migration 28747608-e0df-4b68-b69b-85dc851a090d
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1d690479-e8ce-427c-8008-daaf4ed124b1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d28d44a8-342f-49e6-b443-f86c755a13d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Migration 28747608-e0df-4b68-b69b-85dc851a090d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:45:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:45:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:45:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:24 user nova-compute[72810]: INFO nova.compute.manager [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Terminating instance
Jul 31 18:45:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-dcf9e0f9-f77d-4e1f-8fba-668a87b916f2 req-45899526-841d-49bf-a0bc-a6418d89aca4 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-unplugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Instance destroyed successfully.
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'resources' on Instance uuid 1d690479-e8ce-427c-8008-daaf4ed124b1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-888682122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-40748779',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmzcTGaX9nS+IPLHcm34aV9QCJnOWYD3uYpJ+wJY+NoP48R+pFouoFzaqUUW5MUsgSMCzvlCmeCIWHIsM/uGEAZINUesga7DhYUhZ8y52ldn4ta5TueP8BfzuOB4eaJnw==',key_name='tempest-keypair-1343258428',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-68p88t37',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=1d690479-e8ce-427c-8008-daaf4ed124b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "df39a498-a56b-4dba-94c7-0faccbc50443", "address": "fa:16:3e:7a:4a:9f", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf39a498-a5", "ovs_interfaceid": "df39a498-a56b-4dba-94c7-0faccbc50443", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_vif [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf39a498-a5, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:45:25 user nova-compute[72810]: INFO os_vif [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:4a:9f,bridge_name='br-int',has_traffic_filtering=True,id=df39a498-a56b-4dba-94c7-0faccbc50443,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf39a498-a5')
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OKiZksLh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4b4da0-e7e6-4276-ae1f-4db5271d3651]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c0ec51-bfd5-4c6b-b185-e97cacc7b407]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 (non-flash)
Jul 31 18:45:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601'): ({'sdi'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Removing single pathed devices sdi {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91465db-baad-44d7-a0a8-ea17642483c0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b8541e-1eb0-42d6-86e2-6b4fce1e31a4]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Flushing IO for device /dev/sdi {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bb0d2-2557-457f-8783-bd5565453517]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[18acdce6-d9a6-42b8-b639-04d741a8ce8f]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] SCSI volumes sdi have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_94250dee', '/dev/disk/by-id/scsi-1SCST_BIO94250dee-e32800e88561f819', '/dev/disk/by-id/scsi-26533323830306538') {{(pid=84119) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 18:45:25 user nova-compute[72810]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_94250dee
Jul 31 18:45:25 user nova-compute[72810]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO94250dee-e32800e88561f819
Jul 31 18:45:25 user nova-compute[72810]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26533323830306538
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f2297b-29c5-468b-bca6-8d69010af8a7]: (4, None) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a4208d-6d59-4ead-aa65-d0f065b9a485]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b126b6-28a0-406e-8763-64ee818013f1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260]
Jul 31 18:45:25 user nova-compute[72810]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601, portal: 172.16.0.220,3260] successful.
Jul 31 18:45:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad023e56-151e-454f-bf0c-853c0fdc0601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe74ec0-bb88-44b2-b5fb-a85be3d9b492]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] <== disconnect_volume: return (339ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:45:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deleting instance files /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1_del
Jul 31 18:45:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deletion of /opt/stack/data/nova/instances/1d690479-e8ce-427c-8008-daaf4ed124b1_del complete
Jul 31 18:45:25 user nova-compute[72810]: INFO nova.compute.manager [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 31 18:45:25 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:45:25 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:45:26 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:26 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Took 0.82 seconds to deallocate network for instance.
Jul 31 18:45:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] Acquiring lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] No waiting events found dispatching network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:27 user nova-compute[72810]: WARNING nova.compute.manager [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received unexpected event network-vif-plugged-df39a498-a56b-4dba-94c7-0faccbc50443 for instance with vm_state active and task_state deleting.
Jul 31 18:45:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4574d23-1e04-48bc-ac1f-b1a792f82257 req-0c5d564a-ce21-4303-9c82-011dad172226 service nova] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Received event network-vif-deleted-df39a498-a56b-4dba-94c7-0faccbc50443 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:27 user nova-compute[72810]: INFO nova.compute.manager [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Took 0.86 seconds to detach 1 volumes for instance.
Jul 31 18:45:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Deleting volume: ad023e56-151e-454f-bf0c-853c0fdc0601 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:27 user nova-compute[72810]: INFO nova.compute.manager [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Terminating instance
Jul 31 18:45:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-unplugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] No waiting events found dispatching network-vif-unplugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-b457648b-4cc4-4351-bc0d-1e989c8068b3 req-65e2fb9d-64b4-4911-979a-84fdd9f911c5 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-unplugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:28 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Deleted allocations for instance 1d690479-e8ce-427c-8008-daaf4ed124b1
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32aa562f-e77f-4c76-9db9-2b65a7396b3b tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "1d690479-e8ce-427c-8008-daaf4ed124b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Instance destroyed successfully.
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'resources' on Instance uuid 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-172480222',display_name='tempest-AttachVolumeNegativeTest-server-172480222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-172480222',id=4,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiw9KgdEHmbTOPWBew+ypFhZnOJjhuVew51sHq5clwAwxjWAPr0dhXqW6jr17xw5wEokug5sngwiuwKWMbIKxvmrrG3oquhXXo+ymPj1vpNeWuG1OgkWFkzJwcY9EeO2w==',key_name='tempest-keypair-586305175',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-jh30hbeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=98baf3f0-aed9-4075-a77b-ed6b697e5bc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "address": "fa:16:3e:01:76:d6", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123789e9-5b", "ovs_interfaceid": "123789e9-5b8a-44f1-9aa6-30ebd5a9cccd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG os_vif [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap123789e9-5b, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:28 user nova-compute[72810]: INFO os_vif [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:76:d6,bridge_name='br-int',has_traffic_filtering=True,id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123789e9-5b')
Jul 31 18:45:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Deleting instance files /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6_del
Jul 31 18:45:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Deletion of /opt/stack/data/nova/instances/98baf3f0-aed9-4075-a77b-ed6b697e5bc6_del complete
Jul 31 18:45:28 user nova-compute[72810]: INFO nova.compute.manager [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 31 18:45:28 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:45:28 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:45:29 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:29 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Took 1.10 seconds to deallocate network for instance.
Jul 31 18:45:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-7f02e149-4914-476d-9d5f-91550626c722 req-f826b453-bdb1-40de-8d5d-a044a882d056 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-deleted-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:29 user nova-compute[72810]: INFO nova.compute.manager [req-7f02e149-4914-476d-9d5f-91550626c722 req-f826b453-bdb1-40de-8d5d-a044a882d056 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Neutron deleted interface 123789e9-5b8a-44f1-9aa6-30ebd5a9cccd; detaching it from the instance and deleting it from the info cache
Jul 31 18:45:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-7f02e149-4914-476d-9d5f-91550626c722 req-f826b453-bdb1-40de-8d5d-a044a882d056 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-7f02e149-4914-476d-9d5f-91550626c722 req-f826b453-bdb1-40de-8d5d-a044a882d056 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Detach interface failed, port_id=123789e9-5b8a-44f1-9aa6-30ebd5a9cccd, reason: Instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] Acquiring lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] No waiting events found dispatching network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:30 user nova-compute[72810]: WARNING nova.compute.manager [req-84b8740b-a3aa-465a-9769-4ca9abca753d req-363a4eab-fad6-492e-84b6-2a347f460d64 service nova] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Received unexpected event network-vif-plugged-123789e9-5b8a-44f1-9aa6-30ebd5a9cccd for instance with vm_state deleted and task_state None.
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:30 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Deleted allocations for instance 98baf3f0-aed9-4075-a77b-ed6b697e5bc6
Jul 31 18:45:30 user nova-compute[72810]: INFO nova.compute.manager [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Detaching volume 83f24d4b-26c4-4a56-8ffd-700412d64596
Jul 31 18:45:30 user nova-compute[72810]: INFO nova.virt.block_device [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Attempting to driver detach volume 83f24d4b-26c4-4a56-8ffd-700412d64596 from mountpoint /dev/vdb
Jul 31 18:45:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-89b2462e-9580-4641-a007-061d736562c5 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "98baf3f0-aed9-4075-a77b-ed6b697e5bc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Attempting to detach device vdb from instance c7aebd74-38c4-4925-8723-9d88596169cb from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:45:30 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:45:30 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:45:30 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:45:30 user nova-compute[72810]:   <serial>83f24d4b-26c4-4a56-8ffd-700412d64596</serial>
Jul 31 18:45:30 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 18:45:30 user nova-compute[72810]: </disk>
Jul 31 18:45:30 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:45:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdb from instance c7aebd74-38c4-4925-8723-9d88596169cb from the persistent domain config.
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7aebd74-38c4-4925-8723-9d88596169cb from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:45:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:45:30 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:45:30 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:45:30 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:45:30 user nova-compute[72810]:   <serial>83f24d4b-26c4-4a56-8ffd-700412d64596</serial>
Jul 31 18:45:30 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 18:45:30 user nova-compute[72810]: </disk>
Jul 31 18:45:30 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829131.11192, c7aebd74-38c4-4925-8723-9d88596169cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:45:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdb from instance c7aebd74-38c4-4925-8723-9d88596169cb from the live domain config.
Jul 31 18:45:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcJvLwKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:31 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f937c-0cb9-4ae5-99f3-3bbcb773e10e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe92ba6-b8b7-4b96-bf4b-f8c647a3c330]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:31 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4251b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[361e6f35-2f46-4b13-a008-c0fc765a80a6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532c005-c46f-4df8-9848-38b0e08461ff]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e11dfc0-28c7-43d7-8399-89c029b6842a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c95558-31d6-4cd3-b1bc-996bdec7ff55]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f9d2b-d263-42ee-92a9-dceb55ecec3f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1ccc0-ed8d-40e9-98b0-9fc809ba742a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260]
Jul 31 18:45:31 user nova-compute[72810]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596, portal: 172.16.0.220,3260] successful.
Jul 31 18:45:31 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83f24d4b-26c4-4a56-8ffd-700412d64596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c84924d-0048-4a17-80a3-cbb5ce6324e4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== disconnect_volume: return (315ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e74a19c2-b81a-470c-8f01-c116d3a12271 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72810) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Port 8f869796-d849-427e-91fe-d54efcdb4674 binding to destination host user is already ACTIVE {{(pid=72810) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:33 user nova-compute[72810]: WARNING nova.compute.manager [req-bb62cf8b-2b6e-497e-aaaa-83af521bd024 req-63ee3ebc-e57f-4d7c-9bbd-f6aba6e4b519 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state active and task_state powering-off.
Jul 31 18:45:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance destroyed successfully.
Jul 31 18:45:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-47a18641-ff28-44a5-9420-0af2a4f58aa0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Creating tmpfile /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/tmpuy1oqz14 to verify with other compute node that the instance is on the same shared storage. {{(pid=72810) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:34 user nova-compute[72810]: WARNING nova.compute.manager [req-f8c94baa-cd25-4683-9697-9c20985035b8 req-33020269-e797-42d1-8c0b-4e693b243d06 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state resized and task_state resize_reverting.
Jul 31 18:45:34 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance destroyed successfully.
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'resources' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG os_vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f869796-d8, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:34 user nova-compute[72810]: INFO os_vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:45:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:34 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec586377-3f69-462e-a117-4c6a51ec247b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acaed01-a99d-4436-85a4-498b3944fb9a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:35 user nova-compute[72810]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5a7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'): ({'sdh'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Removing single pathed devices sdh {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4505f6e4-9b63-4dc0-a2bc-1e0632f3b725]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ccf1b1-da0d-4233-982a-5305ca7b6b81]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flushing IO for device /dev/sdh {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda8586a-8871-4f5f-ad5b-0f918f57c377]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2abc4f-8b39-494a-a09f-0503fe33471d]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9e6014-e2fe-4364-86d6-cb76aa5de6ff]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:35 user nova-compute[72810]: WARNING nova.compute.manager [req-89ecce58-2822-4276-94b7-a9d96a8108fc req-3a25b933-be72-4ad8-9b28-925c332770c4 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state None.
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed86e4c-8c1b-422d-a521-aa417d459037]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:45:35 user nova-compute[72810]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:45:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3bc1ec-670e-4e1d-a8e4-2838949fecde]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== disconnect_volume: return (278ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'migration_context' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:36 user nova-compute[72810]: WARNING nova.compute.manager [req-19cacdaf-0b77-489c-8167-019ebac74bca req-338035ae-f429-41bf-9384-ad49c11ff27c service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state resized and task_state resize_reverting.
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.449s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:36 user nova-compute[72810]: INFO nova.compute.manager [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Swapping old allocation on dict_keys(['1f952763-889d-4346-89af-cc061f930545']) held by migration 28747608-e0df-4b68-b69b-85dc851a090d for instance
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Overwriting current allocation {'allocations': {'1f952763-889d-4346-89af-cc061f930545': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '1be7d23c4eb74c43a79711e7253b436c', 'user_id': '13def89025e84e98a4ed596c16e0d0ce', 'consumer_generation': 1} on consumer 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquired lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:45:36 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Releasing lock "refresh_cache-8dc56ab6-c880-4078-9bfb-4b2089655c9f" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.utils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc3a2f3-37f1-4b5b-b4e3-1a7c1c6fb995]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[97832856-9035-48f2-ba91-5c58d4546ee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df6437-8717-4866-9ec0-94b3de941171]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761099f-e658-4aa0-aa6f-260c31923442]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:37 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:45:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab0ba7-ff9d-4fe2-85d9-964f3c11f7b0]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:45:37 user nova-compute[72810]: DEBUG os_brick.utils [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-changed-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Refreshing instance network info cache due to event network-changed-13e413db-6d28-4650-acae-7cd364b74b2a. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] Acquiring lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] Acquired lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Refreshing network info cache for port 13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'flavor' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829125.4813924, 1d690479-e8ce-427c-8008-daaf4ed124b1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:40 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] VM Stopped (Lifecycle Event)
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-5493d7fb-fe5c-44bb-b651-03d1be0577a6 None None] [instance: 1d690479-e8ce-427c-8008-daaf4ed124b1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:40 user nova-compute[72810]: INFO nova.compute.manager [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attaching volume 532d7b2e-809b-4295-87f2-f4dd964335b6 to /dev/vdb
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.utils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff03295-027a-4f7c-98b8-c5882362d418]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478b96e-fc6b-4c1c-8b1a-743d2ca98509]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updated VIF entry in instance network info cache for port 13e413db-6d28-4650-acae-7cd364b74b2a. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating instance_info_cache with network_info: [{"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f1aeb7-32df-41fa-a43b-279ce3c172c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f467cf95-6d90-49bb-a9f7-1659812e419e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1610e509-9dbe-47b4-acb7-2f3951bdeccc req-adb1d481-71fe-4387-86fd-8d5f8932e794 service nova] Releasing lock "refresh_cache-d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:40 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:45:40 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08333f1-82fa-4dbb-bfc9-f31f092c21b9]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG os_brick.utils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:40 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating existing volume attachment record: 828a013f-b33b-47e5-8702-29da1a05701e {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:45:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829128.4537756, 98baf3f0-aed9-4075-a77b-ed6b697e5bc6 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:43 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] VM Stopped (Lifecycle Event)
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3b47009d-9180-4194-ba76-5ac8cda13ce6 None None] [instance: 98baf3f0-aed9-4075-a77b-ed6b697e5bc6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:45:43 user nova-compute[72810]: WARNING nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid d164c447-f733-4779-ad93-1f6e9b4bb72c {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid d28d44a8-342f-49e6-b443-f86c755a13d1 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d138fb7b-7969-4099-8e54-dfd892738660" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "603fa513-0076-4a25-8d93-a6032d551afd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: INFO nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d138fb7b-7969-4099-8e54-dfd892738660" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "603fa513-0076-4a25-8d93-a6032d551afd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Starting finish_revert_migration {{(pid=72810) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start _get_guest_xml network_info=[{"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8dc56ab6-c880-4078-9bfb-4b2089655c9f', 'attached_at': '2023-07-31T18:45:45.000000', 'detached_at': '', 'volume_id': 'dc1ae67d-0e4b-44b6-b270-7370bede66d1', 'serial': 'dc1ae67d-0e4b-44b6-b270-7370bede66d1'}, 'attachment_id': 'a574404e-ac94-42ee-99f3-c4962e99fb99', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:45:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:45:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:45 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be5ea5f-8b1e-4094-aad4-2e76e156d8da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:45:45 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72103a9-168c-48e5-8cb3-78292fbf835f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1] added
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5285ab-b347-4892-9fb7-6214a0514ee9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b4e59-c338-462e-b233-a8e71501f13a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsOniwBN" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2584ffd-f06b-49f2-97ec-58f3a95d14c3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PsOniwBN'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48e9f6b-ecf0-40f8-927d-18e074138848]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096ac4f-6b66-4bd8-9307-5a847df09164]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cf3a2f-ebd8-44df-af99-f6c7c868d8c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:45:45 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574f1de-c62a-4e67-b363-7699d9883eb2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b5b8ec-e41f-45ee-afb5-3bb10b7efc05]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:45 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51179a0d-3cb8-4552-9967-dc150711eac4]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233666236653331', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:45:46 user nova-compute[72810]:   <uuid>8dc56ab6-c880-4078-9bfb-4b2089655c9f</uuid>
Jul 31 18:45:46 user nova-compute[72810]:   <name>instance-00000006</name>
Jul 31 18:45:46 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:45:46 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:45:46 user nova-compute[72810]:   <metadata>
Jul 31 18:45:46 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:45:46 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherB-server-633726612</nova:name>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:45:45</nova:creationTime>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:45:46 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:45:46 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:owner>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:user uuid="13def89025e84e98a4ed596c16e0d0ce">tempest-ServerActionsTestOtherB-275988675-project-member</nova:user>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:project uuid="1be7d23c4eb74c43a79711e7253b436c">tempest-ServerActionsTestOtherB-275988675</nova:project>
Jul 31 18:45:46 user nova-compute[72810]:       </nova:owner>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:45:46 user nova-compute[72810]:       <nova:ports>
Jul 31 18:45:46 user nova-compute[72810]:         <nova:port uuid="8f869796-d849-427e-91fe-d54efcdb4674">
Jul 31 18:45:46 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 18:45:46 user nova-compute[72810]:         </nova:port>
Jul 31 18:45:46 user nova-compute[72810]:       </nova:ports>
Jul 31 18:45:46 user nova-compute[72810]:     </nova:instance>
Jul 31 18:45:46 user nova-compute[72810]:   </metadata>
Jul 31 18:45:46 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:45:46 user nova-compute[72810]:     <system>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="serial">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="uuid">8dc56ab6-c880-4078-9bfb-4b2089655c9f</entry>
Jul 31 18:45:46 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:45:46 user nova-compute[72810]:     </system>
Jul 31 18:45:46 user nova-compute[72810]:   </sysinfo>
Jul 31 18:45:46 user nova-compute[72810]:   <os>
Jul 31 18:45:46 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:45:46 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:45:46 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:45:46 user nova-compute[72810]:   </os>
Jul 31 18:45:46 user nova-compute[72810]:   <features>
Jul 31 18:45:46 user nova-compute[72810]:     <acpi/>
Jul 31 18:45:46 user nova-compute[72810]:     <apic/>
Jul 31 18:45:46 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:45:46 user nova-compute[72810]:   </features>
Jul 31 18:45:46 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:45:46 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:45:46 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:45:46 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:45:46 user nova-compute[72810]:   </clock>
Jul 31 18:45:46 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:45:46 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:45:46 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:45:46 user nova-compute[72810]:   </cpu>
Jul 31 18:45:46 user nova-compute[72810]:   <devices>
Jul 31 18:45:46 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:45:46 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:45:46 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk"/>
Jul 31 18:45:46 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:45:46 user nova-compute[72810]:     </disk>
Jul 31 18:45:46 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:45:46 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:45:46 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:45:46 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:45:46 user nova-compute[72810]:       <serial>dc1ae67d-0e4b-44b6-b270-7370bede66d1</serial>
Jul 31 18:45:46 user nova-compute[72810]:     </disk>
Jul 31 18:45:46 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:45:46 user nova-compute[72810]:       <mac address="fa:16:3e:04:7a:fa"/>
Jul 31 18:45:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:45:46 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:45:46 user nova-compute[72810]:       <target dev="tap8f869796-d8"/>
Jul 31 18:45:46 user nova-compute[72810]:     </interface>
Jul 31 18:45:46 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:45:46 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/console.log" append="off"/>
Jul 31 18:45:46 user nova-compute[72810]:     </serial>
Jul 31 18:45:46 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:45:46 user nova-compute[72810]:     <video>
Jul 31 18:45:46 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:45:46 user nova-compute[72810]:     </video>
Jul 31 18:45:46 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:45:46 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:45:46 user nova-compute[72810]:     </rng>
Jul 31 18:45:46 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:45:46 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:45:46 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:45:46 user nova-compute[72810]:     </memballoon>
Jul 31 18:45:46 user nova-compute[72810]:   </devices>
Jul 31 18:45:46 user nova-compute[72810]: </domain>
Jul 31 18:45:46 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG os_vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f869796-d8, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f869796-d8, col_values=(('external_ids', {'iface-id': '8f869796-d849-427e-91fe-d54efcdb4674', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:7a:fa', 'vm-uuid': '8dc56ab6-c880-4078-9bfb-4b2089655c9f'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:45:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:46 user nova-compute[72810]: INFO os_vif [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:45:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:48 user nova-compute[72810]: WARNING nova.compute.manager [req-02d58a7d-c884-4695-a45d-bd459957ea31 req-813fe6ee-0f91-410e-bce3-1234d8637750 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state resized and task_state resize_reverting.
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829133.5900772, c7aebd74-38c4-4925-8723-9d88596169cb => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Stopped (Lifecycle Event)
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-93b27c5b-6193-4745-b411-6556b8c800c7 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-93b27c5b-6193-4745-b411-6556b8c800c7 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:48 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:45:48 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c165be03-94fd-4caa-b6fc-b84aea736259]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:45:48 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92b96b1-a2bf-4914-883c-e1c2eada5a2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6] added
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619fc6c-5883-4f1d-9509-b9f696bb2a3a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50dc33-aa4e-41e3-835c-73dcfe14c476]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCQHhOVb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCQHhOVb" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ffb00b-fed1-450b-b4f2-0efe34a7cd94]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCQHhOVb'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd3c257-05dc-4586-b020-30741b5af9ed]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0b566-91e4-49b9-9cee-9a7b00ec1bfd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba46aee-f3c1-4dcb-85c0-76938f9e7159]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]
Jul 31 18:45:48 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb256e7-c137-4437-8f8e-c8d8a5be04da]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b11b9ff-009b-4bb9-9818-7f4413f6a69e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:45:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:45:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:49 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc5870e-2526-4ff8-befa-52edbd1a57fc]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:49 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:45:49 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829134.9065711, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:49 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Stopped (Lifecycle Event)
Jul 31 18:45:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2fda1508-9d8c-4bae-ae50-cf22d036bd84 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26439613533386663', 'path': '/dev/sdf'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439613533386663', 'path': '/dev/sdf'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'flavor' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:45:50 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:45:50 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:45:50 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:45:50 user nova-compute[72810]:   <serial>532d7b2e-809b-4295-87f2-f4dd964335b6</serial>
Jul 31 18:45:50 user nova-compute[72810]: </disk>
Jul 31 18:45:50 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829150.4403849, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Resumed (Lifecycle Event)
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance running successfully.
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] finish_revert_migration finished successfully. {{(pid=72810) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:50 user nova-compute[72810]: WARNING nova.compute.manager [req-fa762b08-0df6-4106-8c51-81a73be46911 req-b0231fe7-e340-4e8a-b486-7188a3d09fe6 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state resized and task_state resize_reverting.
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] No VIF found with MAC fa:16:3e:08:63:17, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829150.4421232, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Started (Lifecycle Event)
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 18:45:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ec6b536f-456a-410d-8ac9-20e90711e0ba tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance to original state: 'active'
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bcf3aa12-3e3e-49d7-b960-f4cf38bc5a6a tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.027s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.686s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG os_brick.utils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[27183100-aaa9-40f8-a550-48d3ada5d1cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0ac57b-7a5a-46c9-937b-1c304062201e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b225407-10d4-41ac-8432-8c0a5d9fdc2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a2b3b-7a70-491b-a207-43c859aa16fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:45:52 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:45:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c189d6-f2e6-44a3-9576-410bf3215f68]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:45:52 user nova-compute[72810]: DEBUG os_brick.utils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:45:52 user nova-compute[72810]: INFO nova.compute.manager [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Swapping volume 532d7b2e-809b-4295-87f2-f4dd964335b6 for d088d709-2e99-4b2a-872d-2d731567f675
Jul 31 18:45:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:53 user nova-compute[72810]: INFO nova.compute.manager [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Terminating instance
Jul 31 18:45:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-unplugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] No waiting events found dispatching network-vif-unplugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-75a4d407-e37d-4ebc-bd42-2292350da3f7 req-99b021ba-c88c-408c-bf53-c4030c5e6403 service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-unplugged-d7604c16-d497-4383-954b-102230c1cc54 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Instance destroyed successfully.
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lazy-loading 'resources' on Instance uuid c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1424152566',display_name='tempest-VolumesAdminNegativeTest-server-1424152566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1424152566',id=9,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwGLdep6dy+KFrOrqskzd6fK6f4Y8AXwYesuWqtAzYadxDKYH+B5VFy/aTNPuFgtgPiH3XOcD8y4A0xX7kaueqVjmkFIeco2pC80q8niLXoZFEcyL3bAqYjZC43P54VeA==',key_name='tempest-keypair-68104375',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:40:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b8582394664644b7c51c435c4299ab',ramdisk_id='',reservation_id='r-hh30yn07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2135289877',owner_user_name='tempest-VolumesAdminNegativeTest-2135289877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:40:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd457df295124730b399dbd1fbed9d94',uuid=c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converting VIF {"id": "d7604c16-d497-4383-954b-102230c1cc54", "address": "fa:16:3e:62:6c:eb", "network": {"id": "bcf3e460-08cc-4800-a6fe-3f43594d778e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1288169449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b8582394664644b7c51c435c4299ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7604c16-d4", "ovs_interfaceid": "d7604c16-d497-4383-954b-102230c1cc54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG os_vif [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7604c16-d4, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:54 user nova-compute[72810]: INFO os_vif [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:6c:eb,bridge_name='br-int',has_traffic_filtering=True,id=d7604c16-d497-4383-954b-102230c1cc54,network=Network(bcf3e460-08cc-4800-a6fe-3f43594d778e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7604c16-d4')
Jul 31 18:45:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Deleting instance files /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81_del
Jul 31 18:45:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Deletion of /opt/stack/data/nova/instances/c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81_del complete
Jul 31 18:45:54 user nova-compute[72810]: INFO nova.compute.manager [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Took 1.30 seconds to destroy the instance on the hypervisor.
Jul 31 18:45:54 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:45:54 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-8491d693-6fb4-4f9d-8b15-5bb3ecf3dc6e req-40d5ec76-d9d9-4a95-a950-29512f088f3f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-deleted-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:55 user nova-compute[72810]: INFO nova.compute.manager [req-8491d693-6fb4-4f9d-8b15-5bb3ecf3dc6e req-40d5ec76-d9d9-4a95-a950-29512f088f3f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Neutron deleted interface d7604c16-d497-4383-954b-102230c1cc54; detaching it from the instance and deleting it from the info cache
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-8491d693-6fb4-4f9d-8b15-5bb3ecf3dc6e req-40d5ec76-d9d9-4a95-a950-29512f088f3f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:55 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Took 1.06 seconds to deallocate network for instance.
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-8491d693-6fb4-4f9d-8b15-5bb3ecf3dc6e req-40d5ec76-d9d9-4a95-a950-29512f088f3f service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Detach interface failed, port_id=d7604c16-d497-4383-954b-102230c1cc54, reason: Instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 18:45:55 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] Acquiring lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] No waiting events found dispatching network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:45:56 user nova-compute[72810]: WARNING nova.compute.manager [req-f693d462-2c9c-4c62-9c8f-099b0cdafd1c req-8ed1c04b-3abf-42ea-9367-fb203586f6cd service nova] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Received unexpected event network-vif-plugged-d7604c16-d497-4383-954b-102230c1cc54 for instance with vm_state deleted and task_state None.
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:45:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.787s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:56 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Deleted allocations for instance c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81
Jul 31 18:45:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ca6e960e-6e64-4697-ad37-67eea128db40 tempest-VolumesAdminNegativeTest-2135289877 tempest-VolumesAdminNegativeTest-2135289877-project-member] Lock "c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.403s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:45:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-changed-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing instance network info cache due to event network-changed-fbd39ed7-b0d3-417c-a097-8cd2e8db0932. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] Acquiring lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] Acquired lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Refreshing network info cache for port fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updated VIF entry in instance network info cache for port fbd39ed7-b0d3-417c-a097-8cd2e8db0932. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:45:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f18d2803-6935-4529-a29f-66faea3ca3fa req-5bddf7ce-46b0-48e4-862d-542bbf114628 service nova] Releasing lock "refresh_cache-d28d44a8-342f-49e6-b443-f86c755a13d1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:45:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675', 'serial': 'd088d709-2e99-4b2a-872d-2d731567f675'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': '532d7b2e-809b-4295-87f2-f4dd964335b6', 'serial'} {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:00 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:00 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:00 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3dd3b0-36fb-48b4-921b-7e8a7202098a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:46:00 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[511b3aec-3ba8-4bc1-974b-b7490b193d2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675] added
Jul 31 18:46:00 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[444ea8b4-246d-42d3-8fbb-46b436e34ec1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd2f71-51ef-4910-b19f-5d07c376d8d7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVPSKwvZ {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVPSKwvZ" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23642ac-abaf-4fa5-a229-421961b019e0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVPSKwvZ'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ca63b-7dc0-4710-b7fc-53e5de6934c5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548b254-e252-4b41-9a5d-aec70946ad0e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5cd729-b95f-4017-ba42-fc7ff6f4ec7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260]
Jul 31 18:46:01 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[734927a8-6df4-4307-aa70-0525e9eaee4e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f81daae-619d-4a7d-9270-2b42505d3aa0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] HCTL ('39', '-', '-', 0) found on session 24 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:01 user nova-compute[72810]: INFO nova.compute.manager [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Terminating instance
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b8fea-49df-44f8-97da-f68906667f63]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2538c03-26a7-4e3e-afc4-bc2757d41b17 req-3cb7255b-6173-4af9-b5b1-227f8c96ef37 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-9cd2e132-4320-4eef-a560-600293396286 req-5a00991b-66a9-40b7-9b0f-8bc6cc34cb8b service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-8ac7e333-c36b-4d18-a588-ad617e30c871 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-d6e26594-1a6b-41ad-966b-4a3fc94bf294 req-0d0c9362-989e-4c5d-af50-4c8e3a176187 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Searching for a device in session 24 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26132663665323636', 'path': '/dev/sdh'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132663665323636', 'path': '/dev/sdh'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lazy-loading 'flavor' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Instance destroyed successfully.
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lazy-loading 'resources' on Instance uuid d28d44a8-342f-49e6-b443-f86c755a13d1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbd39ed7-b0, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:19:d9,bridge_name='br-int',has_traffic_filtering=True,id=fbd39ed7-b0d3-417c-a097-8cd2e8db0932,network=Network(cf822fac-ed9c-4c92-9f39-0003ef10929e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd39ed7-b0')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8aa4365-e1, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:b5:e5,bridge_name='br-int',has_traffic_filtering=True,id=e8aa4365-e127-46b7-b52f-37c4cfaaab04,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape8aa4365-e1')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33768b88-d2, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:d0,bridge_name='br-int',has_traffic_filtering=True,id=33768b88-d2fc-4341-ab4f-a8bdedf6dbd8,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap33768b88-d2')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ac7e333-c3, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:00:21,bridge_name='br-int',has_traffic_filtering=True,id=8ac7e333-c36b-4d18-a588-ad617e30c871,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ac7e333-c3')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "address": "fa:16:3e:3b:f5:5f", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf170bd35-f9", "ovs_interfaceid": "f170bd35-f99d-49bf-9d67-c5b9e95df724", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf170bd35-f9, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:f5:5f,bridge_name='br-int',has_traffic_filtering=True,id=f170bd35-f99d-49bf-9d67-c5b9e95df724,network=Network(b8cc1f77-6e9d-49fa-a11d-14077bff1539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf170bd35-f9')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8f2c14-1c, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:77:12,bridge_name='br-int',has_traffic_filtering=True,id=df8f2c14-1ccf-4821-83b5-b75bd7970bc1,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8f2c14-1c')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:43:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2079264601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2079264601',id=16,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe0ay28apF8w5qSTMEpDBYb5/+5W7Cy4lZcd72hK/2uR3ETRhyxTNIEdff4FRKqsYY6+ghLKLlfEu5JZOWTJ1AM8DEgfmwWpMamzy8gGqy6hjy4psUV+4mO1kL43vHqFw==',key_name='tempest-keypair-47249211',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e10f67d01e8b423caedc3d8d09e50fe1',ramdisk_id='',reservation_id='r-c829mfk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1439948650',owner_user_name='tempest-TaggedBootDevicesTest_v242-1439948650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c7914ceb46d40609b917ecc20114a46',uuid=d28d44a8-342f-49e6-b443-f86c755a13d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converting VIF {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90f1212f-f1, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:03 user nova-compute[72810]: INFO os_vif [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:2a:f6,bridge_name='br-int',has_traffic_filtering=True,id=90f1212f-f1af-4124-8604-c56b47069dd7,network=Network(4cdf37ab-616d-456e-b6e8-adc9d40e834c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90f1212f-f1')
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqQvUsBu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 157286400 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c261d4-bac3-4edc-91f8-884edf099dc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ad14e1-225d-4a5c-b326-388c568d111d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec3135b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1675c8b-c854-490f-9697-4075a1665579]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3055332-fe1d-4b81-bcad-e8bef1e2bb68]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 for instance with vm_state active and task_state deleting.
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-e8aa4365-e127-46b7-b52f-37c4cfaaab04 for instance with vm_state active and task_state deleting.
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-33768b88-d2fc-4341-ab4f-a8bdedf6dbd8 for instance with vm_state active and task_state deleting.
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING nova.compute.manager [req-baa398a9-b53b-4332-b220-1dc4ec701bfe req-145b5fc2-b727-422c-8c5d-4d45fc64604c service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 for instance with vm_state active and task_state deleting.
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bca830-1e0e-487c-91b8-0ba71980e45d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a485b58-9c1e-46ef-8d7f-71a69ec77a4d]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[04812cf6-deac-4618-94e1-a6573cabbba7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf870c-0124-4e11-8315-6c95663ace4f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260]
Jul 31 18:46:03 user nova-compute[72810]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2183bc-e621-41f1-bd84-cf5d586d8281 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df1adb-0e2a-4d83-a5c8-54f87c095e17]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== disconnect_volume: return (402ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NYGqLFmP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:03 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5773c265-d072-4ecd-bd04-f9464e081d70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f61bf1-58bd-4196-a3da-a1c03fd76f13]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4906ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b'): ({'sdg'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Removing single pathed devices sdg {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251c278-1ce1-4a27-96ec-07b898b3ed06]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb62246f-bece-4743-96ff-c5c2024b224a]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Flushing IO for device /dev/sdg {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 275775488 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5e82e-e560-423f-9a5a-01ec31fbacfa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:04 user nova-compute[72810]: WARNING nova.compute.manager [req-14c2d821-ec6b-4c63-9c1e-9a75672981b6 req-a098a2a9-3f19-40d4-8537-b2022e6a2c19 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-8ac7e333-c36b-4d18-a588-ad617e30c871 for instance with vm_state active and task_state deleting.
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b1000a-04e9-4317-862b-047963e0caff]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] SCSI volumes sdg have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:04 user nova-compute[72810]: WARNING nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-f170bd35-f99d-49bf-9d67-c5b9e95df724 for instance with vm_state active and task_state deleting.
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-unplugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-unplugged-90f1212f-f1af-4124-8604-c56b47069dd7 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Acquiring lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] No waiting events found dispatching network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:04 user nova-compute[72810]: WARNING nova.compute.manager [req-b567e9da-5d69-41ca-b620-be36bf4fccbd req-e36af821-b137-4efd-96f0-bfc41caedc83 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received unexpected event network-vif-plugged-90f1212f-f1af-4124-8604-c56b47069dd7 for instance with vm_state active and task_state deleting.
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[498fde70-5d26-4610-a8a7-02b5fd8c0f13]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ebfb58-9277-460a-88f4-b110aa001adf]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260]
Jul 31 18:46:04 user nova-compute[72810]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11597ad3-9bdc-412b-99b9-7d714798c55b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbdfdd2-bfa2-4b2a-a991-5e565273ec77]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== disconnect_volume: return (333ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSTEdLCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:04 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[19462c7d-d530-4bf2-99ab-b8a22d981247]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee84fe-7184-46cb-9d34-c4f789d99bfd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5aa170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168b7e4-0125-45e1-be30-2236d89233c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7df027-548c-46a9-971a-0963545d0cf8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1e99f9-e6e3-4da6-b1d2-c8bb78ec28b5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f375f297-70ca-4a97-939f-7ee22ab7a70a]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebca99-269f-4659-b445-1d70b670c8a7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 411041792 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[96218609-fbae-4183-b3d9-f7a345b9703b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260]
Jul 31 18:46:04 user nova-compute[72810]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b116e5b-6466-4bb5-af8a-444a5226a04e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c75529c-75e1-4f38-a44c-d7c044b4bf3b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] <== disconnect_volume: return (366ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Deleting instance files /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1_del
Jul 31 18:46:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Deletion of /opt/stack/data/nova/instances/d28d44a8-342f-49e6-b443-f86c755a13d1_del complete
Jul 31 18:46:04 user nova-compute[72810]: INFO nova.compute.manager [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Took 3.54 seconds to destroy the instance on the hypervisor.
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:46:04 user nova-compute[72810]: INFO nova.compute.manager [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Unrescuing
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:46:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 640679936 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'flavor' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:06 user nova-compute[72810]: WARNING nova.compute.manager [req-cfcf49fa-16c1-4d21-a4ed-c33c3bc64461 req-d0e2e0c6-fa2e-44cc-ab4c-9a6428061f21 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:46:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance destroyed successfully.
Jul 31 18:46:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:07 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[609464c0-3286-48ce-8c04-3d853ae8dbad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e83dda-806f-4a04-add4-2efba143f824]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4126ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'): ({'sdf'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Removing single pathed devices sdf {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c1ff64-0dd7-45e4-ada1-2a5b52b2ba6f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b813f0-8a7a-41d3-8a4f-f82609a7202e]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Flushing IO for device /dev/sdf {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff29331-3ed5-42e0-8519-cdd750851c23]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfa771-f296-43ed-b0f4-1978981ec286]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[248e7721-acdc-4376-8047-7cd26319a82c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bfee9a-cc9d-4840-bbd1-d540ea9cf3d2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]
Jul 31 18:46:07 user nova-compute[72810]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:07 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[01107536-c7b5-4b41-91d3-67ed7021d0b5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== disconnect_volume: return (298ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675', 'serial'} {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: removing Cinder connection for volume 532d7b2e-809b-4295-87f2-f4dd964335b6 {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:08 user nova-compute[72810]: WARNING nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-deleted-f170bd35-f99d-49bf-9d67-c5b9e95df724 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:08 user nova-compute[72810]: INFO nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Neutron deleted interface f170bd35-f99d-49bf-9d67-c5b9e95df724; detaching it from the instance and deleting it from the info cache
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.network.neutron [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [{"id": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "address": "fa:16:3e:cd:19:d9", "network": {"id": "cf822fac-ed9c-4c92-9f39-0003ef10929e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-842846443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd39ed7-b0", "ovs_interfaceid": "fbd39ed7-b0d3-417c-a097-8cd2e8db0932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "address": "fa:16:3e:6d:b5:e5", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8aa4365-e1", "ovs_interfaceid": "e8aa4365-e127-46b7-b52f-37c4cfaaab04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "address": "fa:16:3e:c4:93:d0", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33768b88-d2", "ovs_interfaceid": "33768b88-d2fc-4341-ab4f-a8bdedf6dbd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ac7e333-c36b-4d18-a588-ad617e30c871", "address": "fa:16:3e:66:00:21", "network": {"id": "b8cc1f77-6e9d-49fa-a11d-14077bff1539", "bridge": "br-int", "label": "tempest-device-tagging-net1-1685720880", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ac7e333-c3", "ovs_interfaceid": "8ac7e333-c36b-4d18-a588-ad617e30c871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "address": "fa:16:3e:8b:77:12", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8f2c14-1c", "ovs_interfaceid": "df8f2c14-1ccf-4821-83b5-b75bd7970bc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90f1212f-f1af-4124-8604-c56b47069dd7", "address": "fa:16:3e:e6:2a:f6", "network": {"id": "4cdf37ab-616d-456e-b6e8-adc9d40e834c", "bridge": "br-int", "label": "tempest-device-tagging-net2-847047624", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e10f67d01e8b423caedc3d8d09e50fe1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90f1212f-f1", "ovs_interfaceid": "90f1212f-f1af-4124-8604-c56b47069dd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-63245846-2869-4f8e-9b1f-bb8deb889ac0 req-4159677d-816f-4660-81b9-f0fa3edaac27 service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Detach interface failed, port_id=f170bd35-f99d-49bf-9d67-c5b9e95df724, reason: Instance d28d44a8-342f-49e6-b443-f86c755a13d1 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: Updating volume 532d7b2e-809b-4295-87f2-f4dd964335b6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "nVPSKwvZ", "auth_password": "zmTMD0C2ae1iYK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "d088d709-2e99-4b2a-872d-2d731567f675"}, "status": "reserved", "instance": "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5", "attached_at": "", "detached_at": "", "volume_id": "d088d709-2e99-4b2a-872d-2d731567f675", "serial": "d088d709-2e99-4b2a-872d-2d731567f675"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675', 'no_device': None, 'attachment_id': 'da8576ff-7bba-42b4-8f80-f28cae3fbbb7'} {{(pid=72810) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 18:46:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3bfcb440-03ef-4756-936e-52a826b66704 tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.971s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829154.5276256, c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:09 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] VM Stopped (Lifecycle Event)
Jul 31 18:46:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-18a85755-60ab-4b68-8fb8-8e576168705d None None] [instance: c0f1d556-6ee3-4f45-9cbe-4c980e3a5a81] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG os_brick.utils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aef380-78ac-482c-8530-f9a2ea710427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8549d3d4-049c-41e9-9f6d-ed848efc8eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94bec0a-58d5-4afd-ac58-d936a219a737]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bc18fc-d7ad-4dc7-9cd1-b6c4cd068b8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:46:10 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb79d3c-1bcb-46fd-bfe1-bdb726b4fef0]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG os_brick.utils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:10 user nova-compute[72810]: INFO nova.compute.manager [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Swapping volume d088d709-2e99-4b2a-872d-2d731567f675 for 532d7b2e-809b-4295-87f2-f4dd964335b6
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for d138fb7b-7969-4099-8e54-dfd892738660 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829170.26305, d138fb7b-7969-4099-8e54-dfd892738660 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Resumed (Lifecycle Event)
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-fe22bd1d-283b-450d-86da-5afd794586d9 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:46:10 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Took 5.59 seconds to deallocate network for instance.
Jul 31 18:46:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829170.2652977, d138fb7b-7969-4099-8e54-dfd892738660 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Started (Lifecycle Event)
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:10 user nova-compute[72810]: WARNING nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state None.
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:10 user nova-compute[72810]: WARNING nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state active and task_state None.
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-deleted-fbd39ed7-b0d3-417c-a097-8cd2e8db0932 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-deleted-90f1212f-f1af-4124-8604-c56b47069dd7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-deleted-df8f2c14-1ccf-4821-83b5-b75bd7970bc1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-23de505d-e06c-4cff-804b-90d37336251d req-a5be5eac-5511-4bfc-b94a-66e0f95dc2ed service nova] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Received event network-vif-deleted-8ac7e333-c36b-4d18-a588-ad617e30c871 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:12 user nova-compute[72810]: INFO nova.compute.manager [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Took 2.26 seconds to detach 3 volumes for instance.
Jul 31 18:46:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:46:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.151s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:46:13 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Deleted allocations for instance d28d44a8-342f-49e6-b443-f86c755a13d1
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2d0fffe4-cdab-4d79-9436-7a09a682c512 tempest-TaggedBootDevicesTest_v242-1439948650 tempest-TaggedBootDevicesTest_v242-1439948650-project-member] Lock "d28d44a8-342f-49e6-b443-f86c755a13d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.969s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:16 user nova-compute[72810]: INFO nova.compute.manager [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Terminating instance
Jul 31 18:46:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-unplugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] No waiting events found dispatching network-vif-unplugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-e168a72c-5121-48ca-a47b-7983a2164c99 req-eb69b61a-1016-4f1d-977c-12f608f17503 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-unplugged-a1476142-9922-4e4a-8d94-356504c1bc7b for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:46:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance destroyed successfully.
Jul 31 18:46:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:46:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=25.587718963623047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lazy-loading 'resources' on Instance uuid d164c447-f733-4779-ad93-1f6e9b4bb72c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-394772738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-394772738',id=7,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGab8oF0eScS1hdCvRC/2fY4gHOK31K9nCdwYQY7kSd8mZ6BEd4pOCTP5Ns/AKdTOz7X6wF4nIkp8YlBGwFTJ7B3GyZJURYQx/doK0yFkDuqS4zNkGoDEKQt3Rf8Eew8g==',key_name='tempest-keypair-1002542927',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cb070b24ed34fb6b3f310d3fae39942',ramdisk_id='',reservation_id='r-sojd5jv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-373314597',owner_user_name='tempest-ServerActionsV293TestJSON-373314597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:39:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b274199e036644afba90b84bd12b0f5b',uuid=d164c447-f733-4779-ad93-1f6e9b4bb72c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converting VIF {"id": "a1476142-9922-4e4a-8d94-356504c1bc7b", "address": "fa:16:3e:58:4d:ed", "network": {"id": "7f363f5d-c8ed-4b20-92e0-d8efd7c0b746", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-717868850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cb070b24ed34fb6b3f310d3fae39942", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1476142-99", "ovs_interfaceid": "a1476142-9922-4e4a-8d94-356504c1bc7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG os_vif [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1476142-99, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:17 user nova-compute[72810]: INFO os_vif [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:4d:ed,bridge_name='br-int',has_traffic_filtering=True,id=a1476142-9922-4e4a-8d94-356504c1bc7b,network=Network(7f363f5d-c8ed-4b20-92e0-d8efd7c0b746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1476142-99')
Jul 31 18:46:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Deleting instance files /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c_del
Jul 31 18:46:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Deletion of /opt/stack/data/nova/instances/d164c447-f733-4779-ad93-1f6e9b4bb72c_del complete
Jul 31 18:46:17 user nova-compute[72810]: INFO nova.compute.manager [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d164c447-f733-4779-ad93-1f6e9b4bb72c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:17 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829162.9926746, d28d44a8-342f-49e6-b443-f86c755a13d1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:17 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] VM Stopped (Lifecycle Event)
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d6dfd92e-f004-4494-ae2c-640305332082 None None] [instance: d28d44a8-342f-49e6-b443-f86c755a13d1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Took 1.02 seconds to deallocate network for instance.
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-80511950-4ee6-4dbb-8c27-1024866c4436 req-2a47fe52-be94-4286-84cf-f13a0ac3afde service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-deleted-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': '532d7b2e-809b-4295-87f2-f4dd964335b6', 'serial': '532d7b2e-809b-4295-87f2-f4dd964335b6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675'}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675', 'serial'} {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:18 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:18 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:18 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a336517-6c71-4650-95f6-2d7931d00304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:46:18 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725f4c0-3483-459f-993c-5f20ca5d6814]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6] added
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f85e7-92fb-4253-a67e-70e399a075c1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0181fb-adcb-41c5-abb7-372a09715efa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCQHhOVb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCQHhOVb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e5e228-9b20-4d97-b51c-93358acfd1ad]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCQHhOVb'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[459cf05e-4834-413d-99f2-b2a53ab9456b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da727a5-f86f-4d9c-bf0e-78528bf5c981]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55d160-9eee-4fa0-a398-a02ea8c70e2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]
Jul 31 18:46:18 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f1cbb4-634f-4956-ba5a-1d47e112228f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] Acquiring lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] No waiting events found dispatching network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:18 user nova-compute[72810]: WARNING nova.compute.manager [req-a59e6d6b-8232-422f-9cf1-552d96c139ba req-7d311ac3-b662-4522-840e-7c3f188acb52 service nova] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Received unexpected event network-vif-plugged-a1476142-9922-4e4a-8d94-356504c1bc7b for instance with vm_state deleted and task_state None.
Jul 31 18:46:18 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Deleted allocations for instance d164c447-f733-4779-ad93-1f6e9b4bb72c
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[184a85a5-4e59-4166-8f6a-8e9c0664eebf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:18 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf526b-9d20-45dc-8ea9-95c41ae6bc1e]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:46:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-518be70a-dd7b-475a-b7b8-45abedf17348 tempest-ServerActionsV293TestJSON-373314597 tempest-ServerActionsV293TestJSON-373314597-project-member] Lock "d164c447-f733-4779-ad93-1f6e9b4bb72c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-d164c447-f733-4779-ad93-1f6e9b4bb72c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26439613533386663', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439613533386663', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:46:19 user nova-compute[72810]: DEBUG nova.objects.instance [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lazy-loading 'flavor' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:46:21 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:21 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 657457152 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 783286272 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:46:23 user nova-compute[72810]: INFO nova.compute.claims [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Claim successful on node user
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 903872512 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:46:24 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.policy [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84386ba984b649c69a4a1110fe7954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ba7112dc8b41f8aad49ea1ce030afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:46:24 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Creating image(s)
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "/opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 1065353216 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk 1073741824" returned: 0 in 0.060s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:25 user nova-compute[72810]: INFO nova.compute.manager [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Detaching volume 492e9f72-7dae-4bd9-90b8-f13269254b8f
Jul 31 18:46:25 user nova-compute[72810]: INFO nova.virt.block_device [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Attempting to driver detach volume 492e9f72-7dae-4bd9-90b8-f13269254b8f from mountpoint /dev/vdb
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Attempting to detach device vdb from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:46:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:46:25 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:46:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:46:25 user nova-compute[72810]:   <serial>492e9f72-7dae-4bd9-90b8-f13269254b8f</serial>
Jul 31 18:46:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 18:46:25 user nova-compute[72810]: </disk>
Jul 31 18:46:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:46:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully detached device vdb from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the persistent domain config.
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:46:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:46:25 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:46:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:46:25 user nova-compute[72810]:   <serial>492e9f72-7dae-4bd9-90b8-f13269254b8f</serial>
Jul 31 18:46:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 18:46:25 user nova-compute[72810]: </disk>
Jul 31 18:46:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Successfully created port: 82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Cannot resize image /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'migration_context' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Ensure instance console log exists: /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVPSKwvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd088d709-2e99-4b2a-872d-2d731567f675'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a302360-665d-4e5d-8152-dd589bf042e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5987e3-ff82-4996-8e6c-0a8dcb188ea4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4310c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675'): ({'sdh'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Removing single pathed devices sdh {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb7e886-0840-46d4-af16-5f19d115e50b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0987552c-db6a-46ec-91b4-134d31267c08]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Flushing IO for device /dev/sdh {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb494657-62fa-4138-87e2-31898ace2944]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986f289-b948-4ad3-8d89-0357c2bc4fe4]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] SCSI volumes sdh have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae2f0e3-fb7d-4861-b766-59cbaa8aec54]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ce7fd-cbf6-4ba0-bf64-bfa90b2da51f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260]
Jul 31 18:46:25 user nova-compute[72810]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d088d709-2e99-4b2a-872d-2d731567f675 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffa09cf-ecad-4f98-9e70-6658c98ea9d6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] <== disconnect_volume: return (305ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829185.6498365, 1e9cae76-2122-436a-868b-bb8c500abfe1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:46:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully detached device vdb from instance 1e9cae76-2122-436a-868b-bb8c500abfe1 from the live domain config.
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfZelSsK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74108a8-7c80-48cc-b522-81b6d5504cda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd84b1b3d-d9fc-41f0-a330-b21cd71c1ce5', 'attached_at': '', 'detached_at': '', 'volume_id': '532d7b2e-809b-4295-87f2-f4dd964335b6', 'serial'} {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: removing Cinder connection for volume d088d709-2e99-4b2a-872d-2d731567f675 {{(pid=72810) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e35dd-21cd-4f0b-a428-d65a83a1accf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68fa12a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b109f-5295-4947-b7ce-dd4eb95ddd79]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222aa24-a358-4363-8ed0-40b76311ca5d]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f798e72-1902-4db2-84f0-62240e46fb36]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a775e6-5f5f-4048-b569-5701efcc811f]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3836aa-d82a-4b75-8924-d4a7696d10a9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5c65d0-8b96-4f5b-a5b4-3881eb1a3baf]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260]
Jul 31 18:46:25 user nova-compute[72810]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492e9f72-7dae-4bd9-90b8-f13269254b8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2a45a-2958-4e38-80e6-f5f57764d59a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== disconnect_volume: return (290ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Successfully updated port: 82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquired lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-changed-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Refreshing instance network info cache due to event network-changed-82000850-85e0-44f8-ba5d-d6f66d53c63e. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] Acquiring lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating instance_info_cache with network_info: [{"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Releasing lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Instance network_info: |[{"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] Acquired lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Refreshing network info cache for port 82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Start _get_guest_xml network_info=[{"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:46:26 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:46:26 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953906713',display_name='tempest-AttachVolumeNegativeTest-server-1953906713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953906713',id=20,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCe4bVomqXo4KoBRwbJ4mzVTujgyDN9kOGuUJdgbkGwjTpDJ1GZUsmsf9uX48H5VYlqxJR0QdbAg3iiG3hHP40CwbzOsT7Ul+ICSE1mcncZBsMUsAZbd5NjNn4y8PHCw==',key_name='tempest-keypair-944576963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-w8jiyvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=dafaded3-47bf-416a-9b3e-c77fbd5e62fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'pci_devices' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] swap_volume: Updating volume d088d709-2e99-4b2a-872d-2d731567f675 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "cCQHhOVb", "auth_password": "HmIgBbNkdv3zRG", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "532d7b2e-809b-4295-87f2-f4dd964335b6"}, "status": "reserved", "instance": "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5", "attached_at": "", "detached_at": "", "volume_id": "532d7b2e-809b-4295-87f2-f4dd964335b6", "serial": "532d7b2e-809b-4295-87f2-f4dd964335b6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '532d7b2e-809b-4295-87f2-f4dd964335b6', 'no_device': None, 'attachment_id': '02a67e57-101f-4daa-b468-3f65b35a1dc9'} {{(pid=72810) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:46:26 user nova-compute[72810]:   <uuid>dafaded3-47bf-416a-9b3e-c77fbd5e62fe</uuid>
Jul 31 18:46:26 user nova-compute[72810]:   <name>instance-00000014</name>
Jul 31 18:46:26 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:46:26 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:46:26 user nova-compute[72810]:   <metadata>
Jul 31 18:46:26 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:46:26 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1953906713</nova:name>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:46:26</nova:creationTime>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:46:26 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:46:26 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:owner>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:user uuid="84386ba984b649c69a4a1110fe7954dc">tempest-AttachVolumeNegativeTest-1544720465-project-member</nova:user>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:project uuid="d4ba7112dc8b41f8aad49ea1ce030afb">tempest-AttachVolumeNegativeTest-1544720465</nova:project>
Jul 31 18:46:26 user nova-compute[72810]:       </nova:owner>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:46:26 user nova-compute[72810]:       <nova:ports>
Jul 31 18:46:26 user nova-compute[72810]:         <nova:port uuid="82000850-85e0-44f8-ba5d-d6f66d53c63e">
Jul 31 18:46:26 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:46:26 user nova-compute[72810]:         </nova:port>
Jul 31 18:46:26 user nova-compute[72810]:       </nova:ports>
Jul 31 18:46:26 user nova-compute[72810]:     </nova:instance>
Jul 31 18:46:26 user nova-compute[72810]:   </metadata>
Jul 31 18:46:26 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:46:26 user nova-compute[72810]:     <system>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="serial">dafaded3-47bf-416a-9b3e-c77fbd5e62fe</entry>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="uuid">dafaded3-47bf-416a-9b3e-c77fbd5e62fe</entry>
Jul 31 18:46:26 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:46:26 user nova-compute[72810]:     </system>
Jul 31 18:46:26 user nova-compute[72810]:   </sysinfo>
Jul 31 18:46:26 user nova-compute[72810]:   <os>
Jul 31 18:46:26 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:46:26 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:46:26 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:46:26 user nova-compute[72810]:   </os>
Jul 31 18:46:26 user nova-compute[72810]:   <features>
Jul 31 18:46:26 user nova-compute[72810]:     <acpi/>
Jul 31 18:46:26 user nova-compute[72810]:     <apic/>
Jul 31 18:46:26 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:46:26 user nova-compute[72810]:   </features>
Jul 31 18:46:26 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:46:26 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:46:26 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:46:26 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:46:26 user nova-compute[72810]:   </clock>
Jul 31 18:46:26 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:46:26 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:46:26 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:46:26 user nova-compute[72810]:   </cpu>
Jul 31 18:46:26 user nova-compute[72810]:   <devices>
Jul 31 18:46:26 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:46:26 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:46:26 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk"/>
Jul 31 18:46:26 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:46:26 user nova-compute[72810]:     </disk>
Jul 31 18:46:26 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:46:26 user nova-compute[72810]:       <mac address="fa:16:3e:23:ce:20"/>
Jul 31 18:46:26 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:46:26 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:46:26 user nova-compute[72810]:       <target dev="tap82000850-85"/>
Jul 31 18:46:26 user nova-compute[72810]:     </interface>
Jul 31 18:46:26 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:46:26 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/console.log" append="off"/>
Jul 31 18:46:26 user nova-compute[72810]:     </serial>
Jul 31 18:46:26 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:46:26 user nova-compute[72810]:     <video>
Jul 31 18:46:26 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:46:26 user nova-compute[72810]:     </video>
Jul 31 18:46:26 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:46:26 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:46:26 user nova-compute[72810]:     </rng>
Jul 31 18:46:26 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:46:26 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:46:26 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:46:26 user nova-compute[72810]:     </memballoon>
Jul 31 18:46:26 user nova-compute[72810]:   </devices>
Jul 31 18:46:26 user nova-compute[72810]: </domain>
Jul 31 18:46:26 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953906713',display_name='tempest-AttachVolumeNegativeTest-server-1953906713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953906713',id=20,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCe4bVomqXo4KoBRwbJ4mzVTujgyDN9kOGuUJdgbkGwjTpDJ1GZUsmsf9uX48H5VYlqxJR0QdbAg3iiG3hHP40CwbzOsT7Ul+ICSE1mcncZBsMUsAZbd5NjNn4y8PHCw==',key_name='tempest-keypair-944576963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-w8jiyvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=dafaded3-47bf-416a-9b3e-c77fbd5e62fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG os_vif [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-20aaa5fc-39b1-405e-9a8c-3c85e5e9666b tempest-TestVolumeSwap-1216093133 tempest-TestVolumeSwap-1216093133-project-admin] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.711s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82000850-85, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82000850-85, col_values=(('external_ids', {'iface-id': '82000850-85e0-44f8-ba5d-d6f66d53c63e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:ce:20', 'vm-uuid': 'dafaded3-47bf-416a-9b3e-c77fbd5e62fe'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:26 user nova-compute[72810]: INFO os_vif [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85')
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:23:ce:20, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'flavor' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59810260-bd3e-43e3-8433-5379beb140ec tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updated VIF entry in instance network info cache for port 82000850-85e0-44f8-ba5d-d6f66d53c63e. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating instance_info_cache with network_info: [{"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9c3e1a35-31a2-4862-969c-caf9e702c801 req-8a177df9-b45f-4613-a902-8bd1d2b6ff36 service nova] Releasing lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:27 user nova-compute[72810]: INFO nova.compute.manager [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Detaching volume 532d7b2e-809b-4295-87f2-f4dd964335b6
Jul 31 18:46:27 user nova-compute[72810]: INFO nova.virt.block_device [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Attempting to driver detach volume 532d7b2e-809b-4295-87f2-f4dd964335b6 from mountpoint /dev/vdb
Jul 31 18:46:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Attempting to detach device vdb from instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:46:27 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:46:27 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:46:27 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:46:27 user nova-compute[72810]:   <serial>532d7b2e-809b-4295-87f2-f4dd964335b6</serial>
Jul 31 18:46:27 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:46:27 user nova-compute[72810]: </disk>
Jul 31 18:46:27 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:46:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Successfully detached device vdb from instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 from the persistent domain config.
Jul 31 18:46:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:46:27 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:46:27 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:46:27 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:46:27 user nova-compute[72810]:   <serial>532d7b2e-809b-4295-87f2-f4dd964335b6</serial>
Jul 31 18:46:27 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:46:27 user nova-compute[72810]: </disk>
Jul 31 18:46:27 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] No waiting events found dispatching network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:28 user nova-compute[72810]: WARNING nova.compute.manager [req-684f343f-2d68-4757-9dea-1fe88f77da03 req-1b38f39b-5014-401b-a342-81388de0282d service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received unexpected event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e for instance with vm_state building and task_state spawning.
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829188.2052267, d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:46:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Successfully detached device vdb from instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 from the live domain config.
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCQHhOVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '532d7b2e-809b-4295-87f2-f4dd964335b6'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:28 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c873e48-2d3f-45eb-a1b6-723a4245ae04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce69400d-2894-410d-ab40-232b52a9e1b0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:28 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:28 user nova-compute[72810]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 (non-flash)
Jul 31 18:46:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec312170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550aec0-64df-40a6-89df-952752c3412a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d5dd16-4ec2-4468-a0c0-fe8ff2856167]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c26590-6802-4de4-858f-f7a9fe0d5642]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa742595-d41d-4224-875d-dc59e2852b7f]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[350c101c-ad3a-42be-8947-7238f68e8680]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[640bd5b9-8f94-440f-86cf-d6ed8d5c90c6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260]
Jul 31 18:46:28 user nova-compute[72810]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:28 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:532d7b2e-809b-4295-87f2-f4dd964335b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6b128-31f8-42f6-b85a-5664f9fc0568]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] <== disconnect_volume: return (300ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'flavor' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b32f5f-5654-457e-80f8-437f57a2c243 tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.825s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:29 user nova-compute[72810]: INFO nova.compute.manager [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] instance snapshotting
Jul 31 18:46:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Beginning live snapshot process
Jul 31 18:46:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] No waiting events found dispatching network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:46:30 user nova-compute[72810]: WARNING nova.compute.manager [req-15e046ef-f1f1-459f-aec3-9478d54ec6d3 req-7190dd63-009b-4f69-9ac3-e4ac060243f0 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received unexpected event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e for instance with vm_state building and task_state spawning.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926.delta 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926.delta 1073741824" returned: 0 in 0.049s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829190.3694065, dafaded3-47bf-416a-9b3e-c77fbd5e62fe => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] VM Resumed (Lifecycle Event)
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Instance spawned successfully.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829190.377911, dafaded3-47bf-416a-9b3e-c77fbd5e62fe => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] VM Started (Lifecycle Event)
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Took 6.17 seconds to spawn the instance on the hypervisor.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:30 user nova-compute[72810]: INFO nova.compute.manager [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Took 7.08 seconds to build instance.
Jul 31 18:46:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0cf04226-34cd-4ff6-99d3-4bfa1c7dbdbf tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.343s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 47579136 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:46:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 18:46:32 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829176.9101536, d164c447-f733-4779-ad93-1f6e9b4bb72c => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:46:32 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] VM Stopped (Lifecycle Event)
Jul 31 18:46:32 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:46:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926.delta /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-cafe2da8-17b9-4d3e-91c3-d54f6198345e None None] [instance: d164c447-f733-4779-ad93-1f6e9b4bb72c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:46:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926.delta /opt/stack/data/nova/instances/snapshots/tmps_23itty/09519968452e4df0a525fba2b20dd926" returned: 0 in 0.704s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Snapshot extracted, beginning image upload
Jul 31 18:46:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-changed-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Refreshing instance network info cache due to event network-changed-813ae1b1-e492-4ba2-b8a7-798790b9bafd. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] Acquiring lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] Acquired lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Refreshing network info cache for port 813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:34 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:34 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Ignoring supplied device name: /dev/vdb
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:46:35 user nova-compute[72810]: INFO nova.compute.manager [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Attaching volume 52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 to /dev/vdb
Jul 31 18:46:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updated VIF entry in instance network info cache for port 813ae1b1-e492-4ba2-b8a7-798790b9bafd. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating instance_info_cache with network_info: [{"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f81f6620-e324-4836-b751-14b0337e5a2e req-788814c1-ad24-45ad-96e2-e0aa7ac4b7f0 service nova] Releasing lock "refresh_cache-7366d84b-c5a4-4dbb-94b1-e8001a92655e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb407f5-92c1-48eb-a96f-d913e3b4bd56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc751a4-5a22-4ad4-be50-d5cd171f7bdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8537f7-d21a-48d2-ac53-b92b65eac0c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[431bc12f-3209-4fe3-b0ae-9006256cb343]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:46:35 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:46:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[34181462-93e0-4368-8a90-2bd9748ca157]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:35 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating existing volume attachment record: 92445119-16cc-4789-93e0-a39ab7326306 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:46:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Snapshot image upload complete
Jul 31 18:46:36 user nova-compute[72810]: INFO nova.compute.manager [None req-2ce1b50c-23da-40c6-9c3b-fe853ea85450 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Took 6.62 seconds to snapshot the instance on the hypervisor.
Jul 31 18:46:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAwdoEQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:46:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:46:42 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6a067-d5cc-4b99-afeb-e6bc8b09294c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:46:42 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf31d68f-1bd3-4124-942b-5d93a34787fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1] added
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece01d41-30fd-4a08-83b5-ba4cf6f9b506]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c5b50-a39c-4ac7-abba-582ef403f29d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAwdoEQm {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAwdoEQm" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[870262de-d415-48f5-b200-6e58a01224f7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAwdoEQm'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ccd91-bd2a-476f-97e7-39079436faea]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc593740-c242-41f1-850b-5286c9056614]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c7731b-a8af-4d38-b83f-c467b7aa9914]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260]
Jul 31 18:46:42 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260] successful.
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bd669-0094-4530-acbe-eaf4e9d34f13]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f98c94-ea37-4b9b-9a1c-3b2d4945dacd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)
Jul 31 18:46:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb4c34c-387d-42a7-821b-8b9db57516c3]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:46:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAwdoEQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:46:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:46:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26532363939353039', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:46:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532363939353039', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:46:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:46:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:46:43 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:46:43 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:46:43 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:46:43 user nova-compute[72810]:   <serial>52a3544f-2ebe-4d32-8ca4-3e2edc5889a1</serial>
Jul 31 18:46:43 user nova-compute[72810]: </disk>
Jul 31 18:46:43 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:46:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:46:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:46:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] No VIF found with MAC fa:16:3e:e4:42:c5, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:46:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3deccbf4-6470-4ee8-8a73-383af4339b82 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.283s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:46:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:46:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:11 user nova-compute[72810]: INFO nova.compute.manager [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Detaching volume 52a3544f-2ebe-4d32-8ca4-3e2edc5889a1
Jul 31 18:47:11 user nova-compute[72810]: INFO nova.virt.block_device [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Attempting to driver detach volume 52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 from mountpoint /dev/vdb
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Attempting to detach device vdb from instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:47:11 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:47:11 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:47:11 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:47:11 user nova-compute[72810]:   <serial>52a3544f-2ebe-4d32-8ca4-3e2edc5889a1</serial>
Jul 31 18:47:11 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:47:11 user nova-compute[72810]: </disk>
Jul 31 18:47:11 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:47:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully detached device vdb from instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e from the persistent domain config.
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:47:11 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:47:11 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 18:47:11 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:47:11 user nova-compute[72810]:   <serial>52a3544f-2ebe-4d32-8ca4-3e2edc5889a1</serial>
Jul 31 18:47:11 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:47:11 user nova-compute[72810]: </disk>
Jul 31 18:47:11 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829231.6694663, 7366d84b-c5a4-4dbb-94b1-e8001a92655e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:47:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully detached device vdb from instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e from the live domain config.
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAwdoEQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:47:11 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e183da-bef7-4de1-a0e9-ce7f2b89cd4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b162a78-ff4e-443e-8421-3df14fb19e95]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:11 user nova-compute[72810]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)
Jul 31 18:47:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:11 user nova-compute[72810]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 (non-flash)
Jul 31 18:47:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc424430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31705dd-6a7e-45ed-a6da-8c6f9c6d237b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b016220-740b-448e-a716-97ff869a7d49]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3450f6-1714-498a-85dd-6382a141a240]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8707f0-925a-4554-926f-3f3a451dc2d4]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2f813-c1a0-4e25-8794-ef58c90af021]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[557b8bbc-f909-4dbd-aeb9-822226714b69]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260]
Jul 31 18:47:11 user nova-compute[72810]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1, portal: 172.16.0.220,3260] successful.
Jul 31 18:47:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954f06c-5ee4-4e15-86b2-35840f2e02db]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== disconnect_volume: return (281ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:47:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'flavor' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-69845ab8-d69b-4489-a504-ace8065c96d9 tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.572s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:12 user nova-compute[72810]: INFO nova.compute.manager [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Terminating instance
Jul 31 18:47:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-unplugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] No waiting events found dispatching network-vif-unplugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-6c48fb42-5769-470d-b182-59f2e69c9d3d req-e006521a-fbfd-4188-b9ac-fad78efc1a18 service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-unplugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:47:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Instance destroyed successfully.
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.objects.instance [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lazy-loading 'resources' on Instance uuid 7366d84b-c5a4-4dbb-94b1-e8001a92655e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-269870268',display_name='tempest-VolumesSnapshotTestJSON-instance-269870268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-269870268',id=19,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBd2x4WQcjYAvOs2zDJUzKs8hAGwCBdrdmTzKq8sXBHV7Ij2boEdNvq7TWx2gdVu813w39bPoBUZavtYXTW0QvGzP8Xg5d/PuadRitcKTDNDOcy6snwTWdRFrZCia60Tw==',key_name='tempest-keypair-1921662516',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d5a317bf9243e48b85a0a0633f72d8',ramdisk_id='',reservation_id='r-g40jfohq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1152708704',owner_user_name='tempest-VolumesSnapshotTestJSON-1152708704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26d1d9f9b9f843beb3359f1d43b7b4e8',uuid=7366d84b-c5a4-4dbb-94b1-e8001a92655e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converting VIF {"id": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "address": "fa:16:3e:e4:42:c5", "network": {"id": "591c6b9e-7c96-4f7b-80f7-d427bfb763b9", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-43629912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d5a317bf9243e48b85a0a0633f72d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap813ae1b1-e4", "ovs_interfaceid": "813ae1b1-e492-4ba2-b8a7-798790b9bafd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_vif [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap813ae1b1-e4, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:13 user nova-compute[72810]: INFO os_vif [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:42:c5,bridge_name='br-int',has_traffic_filtering=True,id=813ae1b1-e492-4ba2-b8a7-798790b9bafd,network=Network(591c6b9e-7c96-4f7b-80f7-d427bfb763b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap813ae1b1-e4')
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAwdoEQm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:47:13 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52a3544f-2ebe-4d32-8ca4-3e2edc5889a1', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8763ac-301a-4bb9-bf5a-2ab27bff7cf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b66fb4-84c2-4e8f-8e00-9ddded0dea47]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:13 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:13 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4272e0>, {}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Disconnecting from: [] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] <== disconnect_volume: return (51ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:47:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Deleting instance files /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e_del
Jul 31 18:47:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Deletion of /opt/stack/data/nova/instances/7366d84b-c5a4-4dbb-94b1-e8001a92655e_del complete
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:13 user nova-compute[72810]: INFO nova.compute.manager [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Took 1.05 seconds to destroy the instance on the hypervisor.
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-ff0243ce-5e61-4c2f-bede-8e8dbb6642cb req-c68cdf8c-0675-4825-ba72-2c7acf99812c service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-deleted-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:14 user nova-compute[72810]: INFO nova.compute.manager [req-ff0243ce-5e61-4c2f-bede-8e8dbb6642cb req-c68cdf8c-0675-4825-ba72-2c7acf99812c service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Neutron deleted interface 813ae1b1-e492-4ba2-b8a7-798790b9bafd; detaching it from the instance and deleting it from the info cache
Jul 31 18:47:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-ff0243ce-5e61-4c2f-bede-8e8dbb6642cb req-c68cdf8c-0675-4825-ba72-2c7acf99812c service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:14 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Took 1.01 seconds to deallocate network for instance.
Jul 31 18:47:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-ff0243ce-5e61-4c2f-bede-8e8dbb6642cb req-c68cdf8c-0675-4825-ba72-2c7acf99812c service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Detach interface failed, port_id=813ae1b1-e492-4ba2-b8a7-798790b9bafd, reason: Instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:47:14 user nova-compute[72810]: WARNING nova.volume.cinder [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Attachment 92445119-16cc-4789-93e0-a39ab7326306 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 92445119-16cc-4789-93e0-a39ab7326306. (HTTP 404) (Request-ID: req-4c839638-879e-4576-b4db-6fcc09d0d3f3)
Jul 31 18:47:14 user nova-compute[72810]: INFO nova.compute.manager [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] Acquiring lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] No waiting events found dispatching network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:15 user nova-compute[72810]: WARNING nova.compute.manager [req-f846039f-6cf1-4991-a225-f6a9bf162437 req-4fc4c249-0a55-4225-84e5-d425357868ee service nova] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Received unexpected event network-vif-plugged-813ae1b1-e492-4ba2-b8a7-798790b9bafd for instance with vm_state deleted and task_state None.
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:15 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Deleted allocations for instance 7366d84b-c5a4-4dbb-94b1-e8001a92655e
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-223ec95b-c5fe-49f0-a88d-9c9df844112f tempest-VolumesSnapshotTestJSON-1152708704 tempest-VolumesSnapshotTestJSON-1152708704-project-member] Lock "7366d84b-c5a4-4dbb-94b1-e8001a92655e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.797s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:16 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '7366d84b-c5a4-4dbb-94b1-e8001a92655e' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '7366d84b-c5a4-4dbb-94b1-e8001a92655e' (instance-00000013)
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7598MB free_disk=25.509281158447266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:17 user nova-compute[72810]: INFO nova.compute.manager [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Terminating instance
Jul 31 18:47:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-unplugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] No waiting events found dispatching network-vif-unplugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-ced33dab-7e20-4145-9da8-678fae72b705 req-e622b19b-a28d-4946-9b32-30c96cfb9003 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-unplugged-13e413db-6d28-4650-acae-7cd364b74b2a for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Instance destroyed successfully.
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.objects.instance [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lazy-loading 'resources' on Instance uuid d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1682289298',display_name='tempest-TestVolumeSwap-server-1682289298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1682289298',id=17,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBctQYODPgd3GwLvxg6v6/tb21AD9RhadEzdK4HL86GGH90gv5zuQer5DfUCZAriopcL6N6FBXNqS7vdTExlYKfPetfpWa0THkwpNtAXcojqS++gyol8VfGWTehNkePNag==',key_name='tempest-keypair-2022165580',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:43:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e21ca5b7ebc497cafb9af2f79cb6453',ramdisk_id='',reservation_id='r-c55x4f8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-993383493',owner_user_name='tempest-TestVolumeSwap-993383493-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ae78538787b4a37990ba448a59dcb60',uuid=d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converting VIF {"id": "13e413db-6d28-4650-acae-7cd364b74b2a", "address": "fa:16:3e:08:63:17", "network": {"id": "5029756e-203a-4fd8-86ee-9c301f6814a1", "bridge": "br-int", "label": "tempest-TestVolumeSwap-897021658-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e21ca5b7ebc497cafb9af2f79cb6453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e413db-6d", "ovs_interfaceid": "13e413db-6d28-4650-acae-7cd364b74b2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG os_vif [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13e413db-6d, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:18 user nova-compute[72810]: INFO os_vif [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:63:17,bridge_name='br-int',has_traffic_filtering=True,id=13e413db-6d28-4650-acae-7cd364b74b2a,network=Network(5029756e-203a-4fd8-86ee-9c301f6814a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e413db-6d')
Jul 31 18:47:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Deleting instance files /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5_del
Jul 31 18:47:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Deletion of /opt/stack/data/nova/instances/d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5_del complete
Jul 31 18:47:18 user nova-compute[72810]: INFO nova.compute.manager [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 31 18:47:18 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:47:18 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:47:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:47:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:19 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] Acquiring lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] No waiting events found dispatching network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:20 user nova-compute[72810]: WARNING nova.compute.manager [req-1a48b029-b925-4a0a-a4b5-c2b4c7d6b60c req-88f83aea-1136-4538-a91a-3b0972f63515 service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received unexpected event network-vif-plugged-13e413db-6d28-4650-acae-7cd364b74b2a for instance with vm_state active and task_state deleting.
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:47:20 user nova-compute[72810]: INFO nova.compute.claims [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Claim successful on node user
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-96f3c722-0539-4b0b-ad2b-f54b6b72a125 req-96b63f1a-6bee-46c4-92ce-7a165d1d752c service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Received event network-vif-deleted-13e413db-6d28-4650-acae-7cd364b74b2a {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:21 user nova-compute[72810]: INFO nova.compute.manager [req-96f3c722-0539-4b0b-ad2b-f54b6b72a125 req-96b63f1a-6bee-46c4-92ce-7a165d1d752c service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Neutron deleted interface 13e413db-6d28-4650-acae-7cd364b74b2a; detaching it from the instance and deleting it from the info cache
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-96f3c722-0539-4b0b-ad2b-f54b6b72a125 req-96b63f1a-6bee-46c4-92ce-7a165d1d752c service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:21 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Took 2.46 seconds to deallocate network for instance.
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-96f3c722-0539-4b0b-ad2b-f54b6b72a125 req-96b63f1a-6bee-46c4-92ce-7a165d1d752c service nova] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Detach interface failed, port_id=13e413db-6d28-4650-acae-7cd364b74b2a, reason: Instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:47:21 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:47:21 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Creating image(s)
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.policy [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b0dae9e132b4e198e799027ab8049ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315ad01892ad4ea3bb90546e22b0c25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:21 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Deleted allocations for instance d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk 1073741824" returned: 0 in 0.056s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-24ba29e5-5785-4416-9f7a-8ec0574a7b5c tempest-TestVolumeSwap-993383493 tempest-TestVolumeSwap-993383493-project-member] Lock "d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.174s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.194s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Cannot resize image /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'migration_context' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Ensure instance console log exists: /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Successfully created port: 8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:47:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Successfully updated port: 8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-changed-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing instance network info cache due to event network-changed-8b8193bd-fbe0-4488-ad06-dfa1c6228290. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Instance network_info: |[{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.neutron [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing network info cache for port 8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Start _get_guest_xml network_info=[{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:47:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.objects.instance [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'pci_devices' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:47:23 user nova-compute[72810]:   <uuid>197c109a-6ba4-4e9a-a177-801f3342a23d</uuid>
Jul 31 18:47:23 user nova-compute[72810]:   <name>instance-00000015</name>
Jul 31 18:47:23 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:47:23 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:47:23 user nova-compute[72810]:   <metadata>
Jul 31 18:47:23 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:47:23 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:name>tempest-device-tagging-server-292821082</nova:name>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:47:23</nova:creationTime>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:47:23 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:47:23 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:owner>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:user uuid="8b0dae9e132b4e198e799027ab8049ab">tempest-TaggedAttachmentsTest-1677977488-project-member</nova:user>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:project uuid="315ad01892ad4ea3bb90546e22b0c25e">tempest-TaggedAttachmentsTest-1677977488</nova:project>
Jul 31 18:47:23 user nova-compute[72810]:       </nova:owner>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:47:23 user nova-compute[72810]:       <nova:ports>
Jul 31 18:47:23 user nova-compute[72810]:         <nova:port uuid="8b8193bd-fbe0-4488-ad06-dfa1c6228290">
Jul 31 18:47:23 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:47:23 user nova-compute[72810]:         </nova:port>
Jul 31 18:47:23 user nova-compute[72810]:       </nova:ports>
Jul 31 18:47:23 user nova-compute[72810]:     </nova:instance>
Jul 31 18:47:23 user nova-compute[72810]:   </metadata>
Jul 31 18:47:23 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:47:23 user nova-compute[72810]:     <system>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="serial">197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="uuid">197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:47:23 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:47:23 user nova-compute[72810]:     </system>
Jul 31 18:47:23 user nova-compute[72810]:   </sysinfo>
Jul 31 18:47:23 user nova-compute[72810]:   <os>
Jul 31 18:47:23 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:47:23 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:47:23 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:47:23 user nova-compute[72810]:   </os>
Jul 31 18:47:23 user nova-compute[72810]:   <features>
Jul 31 18:47:23 user nova-compute[72810]:     <acpi/>
Jul 31 18:47:23 user nova-compute[72810]:     <apic/>
Jul 31 18:47:23 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:47:23 user nova-compute[72810]:   </features>
Jul 31 18:47:23 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:47:23 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:47:23 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:47:23 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:47:23 user nova-compute[72810]:   </clock>
Jul 31 18:47:23 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:47:23 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:47:23 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:47:23 user nova-compute[72810]:   </cpu>
Jul 31 18:47:23 user nova-compute[72810]:   <devices>
Jul 31 18:47:23 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:47:23 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:47:23 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk"/>
Jul 31 18:47:23 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:47:23 user nova-compute[72810]:     </disk>
Jul 31 18:47:23 user nova-compute[72810]:     <disk type="file" device="cdrom">
Jul 31 18:47:23 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 18:47:23 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config"/>
Jul 31 18:47:23 user nova-compute[72810]:       <target dev="hda" bus="ide"/>
Jul 31 18:47:23 user nova-compute[72810]:     </disk>
Jul 31 18:47:23 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:47:23 user nova-compute[72810]:       <mac address="fa:16:3e:e6:ac:ce"/>
Jul 31 18:47:23 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:23 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:47:23 user nova-compute[72810]:       <target dev="tap8b8193bd-fb"/>
Jul 31 18:47:23 user nova-compute[72810]:     </interface>
Jul 31 18:47:23 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:47:23 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log" append="off"/>
Jul 31 18:47:23 user nova-compute[72810]:     </serial>
Jul 31 18:47:23 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:47:23 user nova-compute[72810]:     <video>
Jul 31 18:47:23 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:23 user nova-compute[72810]:     </video>
Jul 31 18:47:23 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:47:23 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:47:23 user nova-compute[72810]:     </rng>
Jul 31 18:47:23 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:47:23 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:47:23 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:47:23 user nova-compute[72810]:     </memballoon>
Jul 31 18:47:23 user nova-compute[72810]:   </devices>
Jul 31 18:47:23 user nova-compute[72810]: </domain>
Jul 31 18:47:23 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG os_vif [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8193bd-fb, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b8193bd-fb, col_values=(('external_ids', {'iface-id': '8b8193bd-fbe0-4488-ad06-dfa1c6228290', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ac:ce', 'vm-uuid': '197c109a-6ba4-4e9a-a177-801f3342a23d'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: INFO os_vif [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb')
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name hda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:47:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No VIF found with MAC fa:16:3e:e6:ac:ce, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:47:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Using config drive
Jul 31 18:47:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Creating config drive at /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config
Jul 31 18:47:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdh2elif8 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdh2elif8" returned: 0 in 0.067s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG nova.network.neutron [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updated VIF entry in instance network info cache for port 8b8193bd-fbe0-4488-ad06-dfa1c6228290. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG nova.network.neutron [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-10230f0c-a21a-4483-b1a0-403750502c6b req-7660a5fd-61e8-48f1-be87-259229aa6f3a service nova] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquired lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:47:24 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'info_cache' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Releasing lock "refresh_cache-c7aebd74-38c4-4925-8723-9d88596169cb" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance destroyed successfully.
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'resources' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG os_vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0013d9f-8a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:25 user nova-compute[72810]: INFO os_vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start _get_guest_xml network_info=[{"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'numa_topology' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:25 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:25 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'pci_devices' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:47:25 user nova-compute[72810]:   <uuid>c7aebd74-38c4-4925-8723-9d88596169cb</uuid>
Jul 31 18:47:25 user nova-compute[72810]:   <name>instance-00000008</name>
Jul 31 18:47:25 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:47:25 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:47:25 user nova-compute[72810]:   <metadata>
Jul 31 18:47:25 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:47:25 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeTestJSON-server-2077908289</nova:name>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:47:25</nova:creationTime>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:47:25 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:47:25 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:owner>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:user uuid="3b2bbbd7a792431688c8d575d2c71d21">tempest-AttachVolumeTestJSON-1714901238-project-member</nova:user>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:project uuid="15a633ca9965410aa6ce5b2b86a6f198">tempest-AttachVolumeTestJSON-1714901238</nova:project>
Jul 31 18:47:25 user nova-compute[72810]:       </nova:owner>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:47:25 user nova-compute[72810]:       <nova:ports>
Jul 31 18:47:25 user nova-compute[72810]:         <nova:port uuid="e0013d9f-8ad7-4d9e-8874-6987d6db9c9c">
Jul 31 18:47:25 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:47:25 user nova-compute[72810]:         </nova:port>
Jul 31 18:47:25 user nova-compute[72810]:       </nova:ports>
Jul 31 18:47:25 user nova-compute[72810]:     </nova:instance>
Jul 31 18:47:25 user nova-compute[72810]:   </metadata>
Jul 31 18:47:25 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:47:25 user nova-compute[72810]:     <system>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="serial">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="uuid">c7aebd74-38c4-4925-8723-9d88596169cb</entry>
Jul 31 18:47:25 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:47:25 user nova-compute[72810]:     </system>
Jul 31 18:47:25 user nova-compute[72810]:   </sysinfo>
Jul 31 18:47:25 user nova-compute[72810]:   <os>
Jul 31 18:47:25 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:47:25 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:47:25 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:47:25 user nova-compute[72810]:   </os>
Jul 31 18:47:25 user nova-compute[72810]:   <features>
Jul 31 18:47:25 user nova-compute[72810]:     <acpi/>
Jul 31 18:47:25 user nova-compute[72810]:     <apic/>
Jul 31 18:47:25 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:47:25 user nova-compute[72810]:   </features>
Jul 31 18:47:25 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:47:25 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:47:25 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:47:25 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:47:25 user nova-compute[72810]:   </clock>
Jul 31 18:47:25 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:47:25 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:47:25 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:47:25 user nova-compute[72810]:   </cpu>
Jul 31 18:47:25 user nova-compute[72810]:   <devices>
Jul 31 18:47:25 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:47:25 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:47:25 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk"/>
Jul 31 18:47:25 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:47:25 user nova-compute[72810]:     </disk>
Jul 31 18:47:25 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:47:25 user nova-compute[72810]:       <mac address="fa:16:3e:ed:6c:7c"/>
Jul 31 18:47:25 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:25 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:47:25 user nova-compute[72810]:       <target dev="tape0013d9f-8a"/>
Jul 31 18:47:25 user nova-compute[72810]:     </interface>
Jul 31 18:47:25 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:47:25 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/console.log" append="off"/>
Jul 31 18:47:25 user nova-compute[72810]:     </serial>
Jul 31 18:47:25 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:47:25 user nova-compute[72810]:     <video>
Jul 31 18:47:25 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:25 user nova-compute[72810]:     </video>
Jul 31 18:47:25 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:47:25 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:47:25 user nova-compute[72810]:     </rng>
Jul 31 18:47:25 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:47:25 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:47:25 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:47:25 user nova-compute[72810]:     </memballoon>
Jul 31 18:47:25 user nova-compute[72810]:   </devices>
Jul 31 18:47:25 user nova-compute[72810]: </domain>
Jul 31 18:47:25 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:25 user nova-compute[72810]: WARNING nova.compute.manager [req-c51e5c52-d29a-4eca-9bbf-5378fc9dd919 req-d9c83424-98d1-443d-9cb0-dcb54db637ae service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 for instance with vm_state building and task_state spawning.
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Cannot resize image /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'migration_context' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:45:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG os_vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0013d9f-8a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0013d9f-8a, col_values=(('external_ids', {'iface-id': 'e0013d9f-8ad7-4d9e-8874-6987d6db9c9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:6c:7c', 'vm-uuid': 'c7aebd74-38c4-4925-8723-9d88596169cb'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:26 user nova-compute[72810]: INFO os_vif [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829247.6566093, 197c109a-6ba4-4e9a-a177-801f3342a23d => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] VM Resumed (Lifecycle Event)
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Instance spawned successfully.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829247.6581643, 197c109a-6ba4-4e9a-a177-801f3342a23d => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] VM Started (Lifecycle Event)
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:27 user nova-compute[72810]: WARNING nova.compute.manager [req-eb5ffac3-e605-4905-b290-92be8cc1fd3f req-a559f508-5252-41ba-98aa-6f0b5cbe874b service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 for instance with vm_state building and task_state spawning.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Took 6.27 seconds to spawn the instance on the hypervisor.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:27 user nova-compute[72810]: INFO nova.compute.manager [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Took 7.15 seconds to build instance.
Jul 31 18:47:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cb32fbf-10ea-492a-9e82-fe218dd57919 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.266s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:28 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829233.6082013, 7366d84b-c5a4-4dbb-94b1-e8001a92655e => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:28 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] VM Stopped (Lifecycle Event)
Jul 31 18:47:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a5dfe9bf-8285-4ba2-aa43-948b1d793ca4 None None] [instance: 7366d84b-c5a4-4dbb-94b1-e8001a92655e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:29 user nova-compute[72810]: WARNING nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state powering-on.
Jul 31 18:47:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:29 user nova-compute[72810]: WARNING nova.compute.manager [req-668c7cb3-ee6a-45d5-8e48-e780b6b85744 req-eb42b2e7-5487-4e2c-932e-d026b73e5e6e service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state stopped and task_state powering-on.
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829250.0063848, c7aebd74-38c4-4925-8723-9d88596169cb => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Resumed (Lifecycle Event)
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:47:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance rebooted successfully.
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-fb322a3d-5b2e-4cf6-a8ee-69c69ba142e8 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829250.0073915, c7aebd74-38c4-4925-8723-9d88596169cb => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Started (Lifecycle Event)
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:33 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829238.6808426, d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:33 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] VM Stopped (Lifecycle Event)
Jul 31 18:47:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4e282585-458f-46ee-9579-7f6d702e98d0 None None] [instance: d84b1b3d-d9fc-41f0-a330-b21cd71c1ce5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:47:38 user nova-compute[72810]: INFO nova.compute.claims [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Claim successful on node user
Jul 31 18:47:38 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:47:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:47:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:47:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:47:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:47:39 user nova-compute[72810]: DEBUG nova.policy [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef3882653e7244108f590048754d86b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb86a791f5464179b055746ede494239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:47:39 user nova-compute[72810]: INFO nova.virt.block_device [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Booting with blank volume at /dev/vda
Jul 31 18:47:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Successfully created port: 74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:47:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Successfully updated port: 74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:47:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-changed-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Refreshing instance network info cache due to event network-changed-74c35432-d41a-419a-82ba-21c35cd4b8cb. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance network_info: |[{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:47:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Refreshing network info cache for port 74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:47:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updated VIF entry in instance network info cache for port 74c35432-d41a-419a-82ba-21c35cd4b8cb. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:47:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:47:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8585ff54-9f59-4924-aeff-bbdb329ddde8 req-6ee6f568-e16a-43ef-98f6-8672973a8263 service nova] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:47:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.utils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d34f36-7b11-4f77-8e1b-78efa6617db0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[44df71cb-b341-4650-8b85-af3c0be2ca87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2898848-4b1d-4ed2-984e-97a093fdd748]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88a997-f8f6-4133-95b6-5d90ef5564c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:47:44 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:47:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[04489e3b-9245-4f13-b9b0-ce69d2aec4c1]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG os_brick.utils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:47:44 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating existing volume attachment record: 17618803-1e5f-4150-8537-e5a9756f35cc {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:47:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:47:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Creating image(s)
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Ensure instance console log exists: /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start _get_guest_xml network_info=[{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3bc5689-d177-44f9-9cd8-d8194d711be3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b159a13f-4b04-4cf1-8664-2528b261ba7e', 'serial': 'b159a13f-4b04-4cf1-8664-2528b261ba7e'}, 'attachment_id': '17618803-1e5f-4150-8537-e5a9756f35cc', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:47:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:47:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:47:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:47:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:47:53 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdff060-536d-4ee4-b098-9bbe6a8b68dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:47:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1005ed-20c6-48d8-a0aa-787cb686e939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e] added
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b25b2-fefc-4e08-970d-db4585109e9c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[017784da-6bc5-4d3d-a1ad-483df547ce8e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvAqJalD {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvAqJalD" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f18c86d-8b5f-4499-be1a-d83eaca85e0d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvAqJalD'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a69eac8-8323-4f19-b61d-140be1c0d040]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c014bc2-4998-4188-9c6a-9a591658362b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9dfee-8190-43a3-a7b7-ff8d3619fd7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260]
Jul 31 18:47:53 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260] successful.
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bcc124-049f-4885-a8fa-6d983e221b6f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc5877-8476-4aef-a970-e154d84d0f45]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:53 user nova-compute[72810]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:47:53 user nova-compute[72810]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:47:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f785ab-6aca-45dc-aba4-623089d1e1c3]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:47:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23038363065363563', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038363065363563', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-401461270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-401461270',id=22,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-hblixc2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:47:39Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=a3bc5689-d177-44f9-9cd8-d8194d711be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:47:54 user nova-compute[72810]:   <uuid>a3bc5689-d177-44f9-9cd8-d8194d711be3</uuid>
Jul 31 18:47:54 user nova-compute[72810]:   <name>instance-00000016</name>
Jul 31 18:47:54 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:47:54 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:47:54 user nova-compute[72810]:   <metadata>
Jul 31 18:47:54 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:47:54 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-401461270</nova:name>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:47:52</nova:creationTime>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:47:54 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:47:54 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:owner>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:47:54 user nova-compute[72810]:       </nova:owner>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:47:54 user nova-compute[72810]:       <nova:ports>
Jul 31 18:47:54 user nova-compute[72810]:         <nova:port uuid="74c35432-d41a-419a-82ba-21c35cd4b8cb">
Jul 31 18:47:54 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:47:54 user nova-compute[72810]:         </nova:port>
Jul 31 18:47:54 user nova-compute[72810]:       </nova:ports>
Jul 31 18:47:54 user nova-compute[72810]:     </nova:instance>
Jul 31 18:47:54 user nova-compute[72810]:   </metadata>
Jul 31 18:47:54 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:47:54 user nova-compute[72810]:     <system>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="serial">a3bc5689-d177-44f9-9cd8-d8194d711be3</entry>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="uuid">a3bc5689-d177-44f9-9cd8-d8194d711be3</entry>
Jul 31 18:47:54 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:47:54 user nova-compute[72810]:     </system>
Jul 31 18:47:54 user nova-compute[72810]:   </sysinfo>
Jul 31 18:47:54 user nova-compute[72810]:   <os>
Jul 31 18:47:54 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:47:54 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:47:54 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:47:54 user nova-compute[72810]:   </os>
Jul 31 18:47:54 user nova-compute[72810]:   <features>
Jul 31 18:47:54 user nova-compute[72810]:     <acpi/>
Jul 31 18:47:54 user nova-compute[72810]:     <apic/>
Jul 31 18:47:54 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:47:54 user nova-compute[72810]:   </features>
Jul 31 18:47:54 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:47:54 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:47:54 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:47:54 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:47:54 user nova-compute[72810]:   </clock>
Jul 31 18:47:54 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:47:54 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:47:54 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:47:54 user nova-compute[72810]:   </cpu>
Jul 31 18:47:54 user nova-compute[72810]:   <devices>
Jul 31 18:47:54 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:47:54 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:47:54 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 18:47:54 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:47:54 user nova-compute[72810]:       <serial>b159a13f-4b04-4cf1-8664-2528b261ba7e</serial>
Jul 31 18:47:54 user nova-compute[72810]:     </disk>
Jul 31 18:47:54 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:47:54 user nova-compute[72810]:       <mac address="fa:16:3e:bc:d1:c4"/>
Jul 31 18:47:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:54 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:47:54 user nova-compute[72810]:       <target dev="tap74c35432-d4"/>
Jul 31 18:47:54 user nova-compute[72810]:     </interface>
Jul 31 18:47:54 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:47:54 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/console.log" append="off"/>
Jul 31 18:47:54 user nova-compute[72810]:     </serial>
Jul 31 18:47:54 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:47:54 user nova-compute[72810]:     <video>
Jul 31 18:47:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:47:54 user nova-compute[72810]:     </video>
Jul 31 18:47:54 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:47:54 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:47:54 user nova-compute[72810]:     </rng>
Jul 31 18:47:54 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:47:54 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:47:54 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:47:54 user nova-compute[72810]:     </memballoon>
Jul 31 18:47:54 user nova-compute[72810]:   </devices>
Jul 31 18:47:54 user nova-compute[72810]: </domain>
Jul 31 18:47:54 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-401461270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-401461270',id=22,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-hblixc2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:47:39Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=a3bc5689-d177-44f9-9cd8-d8194d711be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG os_vif [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74c35432-d4, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74c35432-d4, col_values=(('external_ids', {'iface-id': '74c35432-d41a-419a-82ba-21c35cd4b8cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:d1:c4', 'vm-uuid': 'a3bc5689-d177-44f9-9cd8-d8194d711be3'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:54 user nova-compute[72810]: INFO os_vif [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4')
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:47:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:bc:d1:c4, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:47:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:56 user nova-compute[72810]: WARNING nova.compute.manager [req-957db3e6-7fae-4197-ba38-113dd42078d7 req-3e1a5971-e46c-4597-94bc-ae99ceed16ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state building and task_state spawning.
Jul 31 18:47:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:47:58 user nova-compute[72810]: WARNING nova.compute.manager [req-901540f4-3a20-4950-a769-5c3988d9b5a1 req-7589a830-f981-4bd0-8215-82e1521eaa68 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state building and task_state spawning.
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829278.3308074, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Resumed (Lifecycle Event)
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance spawned successfully.
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829278.332468, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Started (Lifecycle Event)
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Took 5.52 seconds to spawn the instance on the hypervisor.
Jul 31 18:47:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:47:58 user nova-compute[72810]: INFO nova.compute.manager [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Took 20.09 seconds to build instance.
Jul 31 18:47:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4b4e2c9a-4bc4-42d2-a0f8-eb05a663d596 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.198s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:47:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:47:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:48:02 user nova-compute[72810]: INFO nova.compute.claims [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Claim successful on node user
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.374s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:48:02 user nova-compute[72810]: INFO nova.compute.claims [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Claim successful on node user
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:48:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.policy [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb5f82edcbc8455d8ddf98bcaa9e4e58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d44d8eaa8e49869ff52813946162f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:48:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Creating image(s)
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "/opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "/opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk 1073741824" returned: 0 in 0.097s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:48:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.policy [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf8b9f2a471b40b7ba541f9da121207a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3897e37c484827819b5d56cee9345a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:48:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Creating image(s)
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Cannot resize image /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'migration_context' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Successfully created port: e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Ensure instance console log exists: /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk 1073741824" returned: 0 in 0.056s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Cannot resize image /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Ensure instance console log exists: /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Successfully created port: f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Successfully updated port: e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquired lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-changed-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Refreshing instance network info cache due to event network-changed-e099c423-4f6a-4a2c-a4e5-2ca33b33676b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] Acquiring lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Successfully updated port: f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing instance network info cache due to event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updating instance_info_cache with network_info: [{"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Releasing lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Instance network_info: |[{"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] Acquired lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Refreshing network info cache for port e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Start _get_guest_xml network_info=[{"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:48:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7691945',id=23,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwVg/+r9aYw0N+BLKYeacXjy5SVx4fQmoqtLln8ru3keqK6lBQPR5Y3I5ICFRIFOCzkOACQiwD2lRz8iguer3b+5WWkjTjYt5/EmQZDEq6gMhyVM4wBJ73OPScf2yOyug==',key_name='tempest-keypair-829386307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d44d8eaa8e49869ff52813946162f7',ramdisk_id='',reservation_id='r-7ckpdwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb5f82edcbc8455d8ddf98bcaa9e4e58',uuid=0ac70112-5aaf-493c-b810-3ad743b483e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converting VIF {"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.objects.instance [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:48:05 user nova-compute[72810]:   <uuid>0ac70112-5aaf-493c-b810-3ad743b483e6</uuid>
Jul 31 18:48:05 user nova-compute[72810]:   <name>instance-00000017</name>
Jul 31 18:48:05 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:48:05 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:48:05 user nova-compute[72810]:   <metadata>
Jul 31 18:48:05 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:48:05 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510</nova:name>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:48:05</nova:creationTime>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:48:05 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:owner>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:user uuid="bb5f82edcbc8455d8ddf98bcaa9e4e58">tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member</nova:user>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:project uuid="c8d44d8eaa8e49869ff52813946162f7">tempest-TestServerVolumeAttachScenarioOldVersion-1244144456</nova:project>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:owner>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:ports>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:port uuid="e099c423-4f6a-4a2c-a4e5-2ca33b33676b">
Jul 31 18:48:05 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 18:48:05 user nova-compute[72810]:         </nova:port>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:ports>
Jul 31 18:48:05 user nova-compute[72810]:     </nova:instance>
Jul 31 18:48:05 user nova-compute[72810]:   </metadata>
Jul 31 18:48:05 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:48:05 user nova-compute[72810]:     <system>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="serial">0ac70112-5aaf-493c-b810-3ad743b483e6</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="uuid">0ac70112-5aaf-493c-b810-3ad743b483e6</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:48:05 user nova-compute[72810]:     </system>
Jul 31 18:48:05 user nova-compute[72810]:   </sysinfo>
Jul 31 18:48:05 user nova-compute[72810]:   <os>
Jul 31 18:48:05 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:48:05 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:48:05 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:48:05 user nova-compute[72810]:   </os>
Jul 31 18:48:05 user nova-compute[72810]:   <features>
Jul 31 18:48:05 user nova-compute[72810]:     <acpi/>
Jul 31 18:48:05 user nova-compute[72810]:     <apic/>
Jul 31 18:48:05 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:48:05 user nova-compute[72810]:   </features>
Jul 31 18:48:05 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:48:05 user nova-compute[72810]:   </clock>
Jul 31 18:48:05 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:48:05 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:48:05 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:48:05 user nova-compute[72810]:   </cpu>
Jul 31 18:48:05 user nova-compute[72810]:   <devices>
Jul 31 18:48:05 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:48:05 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:48:05 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk"/>
Jul 31 18:48:05 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:     </disk>
Jul 31 18:48:05 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:48:05 user nova-compute[72810]:       <mac address="fa:16:3e:df:6e:4f"/>
Jul 31 18:48:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:48:05 user nova-compute[72810]:       <target dev="tape099c423-4f"/>
Jul 31 18:48:05 user nova-compute[72810]:     </interface>
Jul 31 18:48:05 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:48:05 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/console.log" append="off"/>
Jul 31 18:48:05 user nova-compute[72810]:     </serial>
Jul 31 18:48:05 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:48:05 user nova-compute[72810]:     <video>
Jul 31 18:48:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:     </video>
Jul 31 18:48:05 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:48:05 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:48:05 user nova-compute[72810]:     </rng>
Jul 31 18:48:05 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:48:05 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:48:05 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:48:05 user nova-compute[72810]:     </memballoon>
Jul 31 18:48:05 user nova-compute[72810]:   </devices>
Jul 31 18:48:05 user nova-compute[72810]: </domain>
Jul 31 18:48:05 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7691945',id=23,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwVg/+r9aYw0N+BLKYeacXjy5SVx4fQmoqtLln8ru3keqK6lBQPR5Y3I5ICFRIFOCzkOACQiwD2lRz8iguer3b+5WWkjTjYt5/EmQZDEq6gMhyVM4wBJ73OPScf2yOyug==',key_name='tempest-keypair-829386307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8d44d8eaa8e49869ff52813946162f7',ramdisk_id='',reservation_id='r-7ckpdwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb5f82edcbc8455d8ddf98bcaa9e4e58',uuid=0ac70112-5aaf-493c-b810-3ad743b483e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converting VIF {"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG os_vif [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape099c423-4f, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape099c423-4f, col_values=(('external_ids', {'iface-id': 'e099c423-4f6a-4a2c-a4e5-2ca33b33676b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:6e:4f', 'vm-uuid': '0ac70112-5aaf-493c-b810-3ad743b483e6'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: INFO os_vif [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f')
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] No VIF found with MAC fa:16:3e:df:6e:4f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance network_info: |[{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start _get_guest_xml network_info=[{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:48:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-177221635',display_name='tempest-ServerRescueNegativeTestJSON-server-177221635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-177221635',id=24,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgtIHJMOkOY43Ou5M6fEyasQ9qqg4CbBsglARvf6ql9ZGf8quXSJhnruUMbXrBMk6+Tysmz5zDC2niFR9jiaUPrqTz0SUcY55gdmIbIWWQRtOidTnxeUVzPw7xTvsugQ==',key_name='tempest-keypair-1658891605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-vf5ys7ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=7148a69e-e93d-407a-ba32-71442fbaae2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.objects.instance [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:48:05 user nova-compute[72810]:   <uuid>7148a69e-e93d-407a-ba32-71442fbaae2e</uuid>
Jul 31 18:48:05 user nova-compute[72810]:   <name>instance-00000018</name>
Jul 31 18:48:05 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:48:05 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:48:05 user nova-compute[72810]:   <metadata>
Jul 31 18:48:05 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:48:05 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-177221635</nova:name>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:48:05</nova:creationTime>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:48:05 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:owner>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:owner>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:48:05 user nova-compute[72810]:       <nova:ports>
Jul 31 18:48:05 user nova-compute[72810]:         <nova:port uuid="f26fc84b-a55b-40eb-a612-379f0ad7a380">
Jul 31 18:48:05 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 18:48:05 user nova-compute[72810]:         </nova:port>
Jul 31 18:48:05 user nova-compute[72810]:       </nova:ports>
Jul 31 18:48:05 user nova-compute[72810]:     </nova:instance>
Jul 31 18:48:05 user nova-compute[72810]:   </metadata>
Jul 31 18:48:05 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:48:05 user nova-compute[72810]:     <system>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="serial">7148a69e-e93d-407a-ba32-71442fbaae2e</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="uuid">7148a69e-e93d-407a-ba32-71442fbaae2e</entry>
Jul 31 18:48:05 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:48:05 user nova-compute[72810]:     </system>
Jul 31 18:48:05 user nova-compute[72810]:   </sysinfo>
Jul 31 18:48:05 user nova-compute[72810]:   <os>
Jul 31 18:48:05 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:48:05 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:48:05 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:48:05 user nova-compute[72810]:   </os>
Jul 31 18:48:05 user nova-compute[72810]:   <features>
Jul 31 18:48:05 user nova-compute[72810]:     <acpi/>
Jul 31 18:48:05 user nova-compute[72810]:     <apic/>
Jul 31 18:48:05 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:48:05 user nova-compute[72810]:   </features>
Jul 31 18:48:05 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:48:05 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:48:05 user nova-compute[72810]:   </clock>
Jul 31 18:48:05 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:48:05 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:48:05 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:48:05 user nova-compute[72810]:   </cpu>
Jul 31 18:48:05 user nova-compute[72810]:   <devices>
Jul 31 18:48:05 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:48:05 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:48:05 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk"/>
Jul 31 18:48:05 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:     </disk>
Jul 31 18:48:05 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:48:05 user nova-compute[72810]:       <mac address="fa:16:3e:eb:f2:29"/>
Jul 31 18:48:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:48:05 user nova-compute[72810]:       <target dev="tapf26fc84b-a5"/>
Jul 31 18:48:05 user nova-compute[72810]:     </interface>
Jul 31 18:48:05 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:48:05 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/console.log" append="off"/>
Jul 31 18:48:05 user nova-compute[72810]:     </serial>
Jul 31 18:48:05 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:48:05 user nova-compute[72810]:     <video>
Jul 31 18:48:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:05 user nova-compute[72810]:     </video>
Jul 31 18:48:05 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:48:05 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:48:05 user nova-compute[72810]:     </rng>
Jul 31 18:48:05 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:48:05 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:48:05 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:48:05 user nova-compute[72810]:     </memballoon>
Jul 31 18:48:05 user nova-compute[72810]:   </devices>
Jul 31 18:48:05 user nova-compute[72810]: </domain>
Jul 31 18:48:05 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-177221635',display_name='tempest-ServerRescueNegativeTestJSON-server-177221635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-177221635',id=24,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgtIHJMOkOY43Ou5M6fEyasQ9qqg4CbBsglARvf6ql9ZGf8quXSJhnruUMbXrBMk6+Tysmz5zDC2niFR9jiaUPrqTz0SUcY55gdmIbIWWQRtOidTnxeUVzPw7xTvsugQ==',key_name='tempest-keypair-1658891605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-vf5ys7ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=7148a69e-e93d-407a-ba32-71442fbaae2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG os_vif [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf26fc84b-a5, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf26fc84b-a5, col_values=(('external_ids', {'iface-id': 'f26fc84b-a55b-40eb-a612-379f0ad7a380', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:f2:29', 'vm-uuid': '7148a69e-e93d-407a-ba32-71442fbaae2e'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:05 user nova-compute[72810]: INFO os_vif [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5')
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:eb:f2:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG nova.network.neutron [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updated VIF entry in instance network info cache for port e099c423-4f6a-4a2c-a4e5-2ca33b33676b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG nova.network.neutron [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updating instance_info_cache with network_info: [{"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf7722ad-f197-43df-a344-2d64d52ef80a req-34bc6e17-2958-44b5-9d0a-cdc412c4ce58 service nova] Releasing lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG nova.network.neutron [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updated VIF entry in instance network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG nova.network.neutron [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b6c5f56-e587-4c4f-b5a7-f81fcd4591e9 req-ba06533b-adc8-4efd-a3b6-99f6a7fba47c service nova] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] No waiting events found dispatching network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:08 user nova-compute[72810]: WARNING nova.compute.manager [req-f6ddda82-ade1-42b0-b780-4a07132d55cc req-7d6236a6-b257-45e7-9a2d-d11c340ded63 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received unexpected event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b for instance with vm_state building and task_state spawning.
Jul 31 18:48:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:08 user nova-compute[72810]: WARNING nova.compute.manager [req-cc9e20a1-3ebf-4147-8c95-42241b39be9c req-9fda81a6-89e5-4d3e-af39-29e1a21539f8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state building and task_state spawning.
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] No waiting events found dispatching network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:10 user nova-compute[72810]: WARNING nova.compute.manager [req-f210b568-f1ab-41be-91e4-23122b9843cc req-0151c00f-c7e9-42a8-8f25-fc93c2a57800 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received unexpected event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b for instance with vm_state building and task_state spawning.
Jul 31 18:48:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:10 user nova-compute[72810]: WARNING nova.compute.manager [req-fbecef51-4ea7-42c3-b997-234b1c42c8c0 req-95237ef3-cb85-4342-9361-c3c7942cf2d9 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state building and task_state spawning.
Jul 31 18:48:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829291.1015143, 0ac70112-5aaf-493c-b810-3ad743b483e6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] VM Resumed (Lifecycle Event)
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Instance spawned successfully.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829291.101741, 0ac70112-5aaf-493c-b810-3ad743b483e6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] VM Started (Lifecycle Event)
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance spawned successfully.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Took 8.26 seconds to spawn the instance on the hypervisor.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829291.189629, 7148a69e-e93d-407a-ba32-71442fbaae2e => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Resumed (Lifecycle Event)
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829291.1898808, 7148a69e-e93d-407a-ba32-71442fbaae2e => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Started (Lifecycle Event)
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Took 7.66 seconds to spawn the instance on the hypervisor.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Took 9.14 seconds to build instance.
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66ebb488-b288-4ad8-a5e4-b262c0f6a91c tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.244s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:11 user nova-compute[72810]: INFO nova.compute.manager [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Took 9.12 seconds to build instance.
Jul 31 18:48:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7f99fd80-7e6f-463c-a747-2ce1963c9952 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.236s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:48:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-changed-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Refreshing instance network info cache due to event network-changed-82000850-85e0-44f8-ba5d-d6f66d53c63e. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] Acquiring lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] Acquired lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Refreshing network info cache for port 82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updated VIF entry in instance network info cache for port 82000850-85e0-44f8-ba5d-d6f66d53c63e. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating instance_info_cache with network_info: [{"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d053ba4-29ec-40c0-a3c2-1b0bdbdbf80f req-8a3bf0f8-a820-4870-a4a1-0aad7578186a service nova] Releasing lock "refresh_cache-dafaded3-47bf-416a-9b3e-c77fbd5e62fe" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.51708221435547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:48:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 197c109a-6ba4-4e9a-a177-801f3342a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0ac70112-5aaf-493c-b810-3ad743b483e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:48:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:19 user nova-compute[72810]: DEBUG nova.objects.instance [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:20 user nova-compute[72810]: INFO nova.compute.manager [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Attaching volume 4fa54af0-79ce-437f-bf2b-5484c2a7ab71 to /dev/vdb
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.utils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f66afe-4ae7-4e56-82b4-f153583a5c91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a14298-d79a-4e7e-ba4d-9a559d31cea7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dae127-a46f-4f24-8271-f58784394895]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c0f7cd-bef0-4b86-bd28-c0941d491bc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:48:20 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b629f97-e721-41d3-8ebd-f5861805c25f]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG os_brick.utils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating existing volume attachment record: 241cc536-a7a6-44b3-8915-04b7184fd783 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:48:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:24 user nova-compute[72810]: INFO nova.compute.manager [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Terminating instance
Jul 31 18:48:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-022ec255-4305-4533-a58f-8dc08f6ee1ae req-044a8254-edfa-43f6-9c66-927c8cf405dd service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-unplugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:48:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Instance destroyed successfully.
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.objects.instance [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lazy-loading 'resources' on Instance uuid 8dc56ab6-c880-4078-9bfb-4b2089655c9f {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-633726612',display_name='tempest-ServerActionsTestOtherB-server-633726612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-633726612',id=6,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLHbyX2KvPZPbjOfkUwFiRJTnIe8NlnLq1WW2bU2Uc3M//uZ/3h2uFrynasmmWJgEpx0ww0YEHJ1OScPQnDqxZYxEKLTZX5PVQR+YlwK930MpJtLoDkecckNu+zJ/Osg==',key_name='tempest-keypair-720844502',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:45:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1be7d23c4eb74c43a79711e7253b436c',ramdisk_id='',reservation_id='r-w0ws6z84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-275988675',owner_user_name='tempest-ServerActionsTestOtherB-275988675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13def89025e84e98a4ed596c16e0d0ce',uuid=8dc56ab6-c880-4078-9bfb-4b2089655c9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converting VIF {"id": "8f869796-d849-427e-91fe-d54efcdb4674", "address": "fa:16:3e:04:7a:fa", "network": {"id": "8ea372cc-2d60-4105-a412-9dc9bc7c908a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-626102637-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1be7d23c4eb74c43a79711e7253b436c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f869796-d8", "ovs_interfaceid": "8f869796-d849-427e-91fe-d54efcdb4674", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_vif [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f869796-d8, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:25 user nova-compute[72810]: INFO os_vif [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:7a:fa,bridge_name='br-int',has_traffic_filtering=True,id=8f869796-d849-427e-91fe-d54efcdb4674,network=Network(8ea372cc-2d60-4105-a412-9dc9bc7c908a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f869796-d8')
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsOniwBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f082ce-7089-4b31-a25d-b311e9901343]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edceae9-2d25-4a1a-bf18-a9717a763b01]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:48:25 user nova-compute[72810]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 (non-flash)
Jul 31 18:48:25 user nova-compute[72810]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5aa320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[93740fb0-8ae6-4ac3-ad13-4b56a6fbd013]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89536ee9-475c-4a7c-87cf-c9a5bd91132c]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[11232420-5da8-42b9-80fb-440580772673]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.065s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a4502-3da2-4b9b-b7fd-9a9cdf2356bf]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ba977a-313e-41c6-bdca-5be0375b89b5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7934a7af-82ad-4bc7-b523-56cc75d9c5df]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260]
Jul 31 18:48:25 user nova-compute[72810]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1, portal: 172.16.0.220,3260] successful.
Jul 31 18:48:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc1ae67d-0e4b-44b6-b270-7370bede66d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053d9c2-ff71-4225-a656-7d2d7e0c9f5d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] <== disconnect_volume: return (339ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:48:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Deleting instance files /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_del
Jul 31 18:48:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Deletion of /opt/stack/data/nova/instances/8dc56ab6-c880-4078-9bfb-4b2089655c9f_del complete
Jul 31 18:48:25 user nova-compute[72810]: INFO nova.compute.manager [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 31 18:48:25 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:48:25 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] Acquiring lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] No waiting events found dispatching network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:27 user nova-compute[72810]: WARNING nova.compute.manager [req-7c9c2283-ace3-47b8-b5a0-16e099d75627 req-031cd507-856a-4d2d-a466-ee311e0c6a02 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received unexpected event network-vif-plugged-8f869796-d849-427e-91fe-d54efcdb4674 for instance with vm_state active and task_state deleting.
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:48:27 user nova-compute[72810]: INFO nova.compute.claims [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Claim successful on node user
Jul 31 18:48:27 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:27 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Took 2.09 seconds to deallocate network for instance.
Jul 31 18:48:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:48:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:48:28 user nova-compute[72810]: INFO nova.virt.block_device [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Booting with volume 048e03ab-5ec8-440a-8ba0-cff75772ef83 at /dev/vda
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.policy [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a818426c4f424127a01cb9f57e076603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38248d933d4d42a9aca885b10fbd1afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98ca607-da7d-4c5c-bbf6-e43df718528c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f10365-a6b5-4ab0-a1c6-ad9e57bcf833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a79afd0-9f7f-4ddf-bc4e-db9bcd9c4624]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ad5b8-dcca-4a23-9839-a256be842aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:48:28 user nova-compute[72810]: INFO nova.compute.manager [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Took 1.03 seconds to detach 1 volumes for instance.
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:48:28 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:48:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64e4f9-7ce6-41cb-b0aa-fcfde91d096f]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:28 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating existing volume attachment record: 9a360bec-ab0c-497c-987a-2b3ff377c38a {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmbLVdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:29 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:29 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:29 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8877dc-101f-498b-8446-02374595ca60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:48:29 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[470c8ddd-327d-44ad-a3cb-2fb5f4e46876]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71] added
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a415bf1d-df25-48fd-a6b0-bfec1d98c0eb]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f7c29-ae14-45ad-a94c-f379c1639572]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARmbLVdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARmbLVdc" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0dce4a-f7ec-4433-a9ce-504dad991738]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARmbLVdc'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e93b63-4970-4d82-9fdd-dad911e1decc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6f023e-957a-40fa-b0a0-b4db7ac96ae5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d4070-178d-4fbf-9187-bba64b6bcf26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260]
Jul 31 18:48:29 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260] successful.
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a2e942-c67b-464d-93d7-f37b05d69db5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a91873-7fbd-455a-ae2a-0dde6dfa84c5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:29 user nova-compute[72810]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:29 user nova-compute[72810]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)
Jul 31 18:48:29 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20b914-1410-4f71-8071-224c32138765]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmbLVdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-10b033b9-cf62-4190-9940-101b3cb9bd78 req-c323c6ba-f3b5-468d-a3af-8a1b32519a37 service nova] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Received event network-vif-deleted-8f869796-d849-427e-91fe-d54efcdb4674 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:29 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Deleted allocations for instance 8dc56ab6-c880-4078-9bfb-4b2089655c9f
Jul 31 18:48:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-12f818b8-916a-467b-af61-b451c03371f9 tempest-ServerActionsTestOtherB-275988675 tempest-ServerActionsTestOtherB-275988675-project-member] Lock "8dc56ab6-c880-4078-9bfb-4b2089655c9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.151s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Successfully created port: 2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23437396161343231', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437396161343231', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:48:30 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:48:30 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:48:30 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:48:30 user nova-compute[72810]:   <serial>4fa54af0-79ce-437f-bf2b-5484c2a7ab71</serial>
Jul 31 18:48:30 user nova-compute[72810]: </disk>
Jul 31 18:48:30 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:23:ce:20, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Successfully updated port: 2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-db0c0bd8-09c4-42ac-9c6f-62abe3c1ad0a tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.998s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance network_info: |[{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-changed-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Refreshing instance network info cache due to event network-changed-2d7abd07-ce56-49ef-860e-be4aab4c2841. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Refreshing network info cache for port 2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updated VIF entry in instance network info cache for port 2d7abd07-ce56-49ef-860e-be4aab4c2841. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2afbebc4-63bb-4fa3-9c9a-46612d64d3b9 req-448dc6a7-6b0d-454a-a217-a9b15b45ad55 service nova] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:32 user nova-compute[72810]: INFO nova.compute.manager [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Detaching volume 4fa54af0-79ce-437f-bf2b-5484c2a7ab71
Jul 31 18:48:32 user nova-compute[72810]: INFO nova.virt.block_device [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Attempting to driver detach volume 4fa54af0-79ce-437f-bf2b-5484c2a7ab71 from mountpoint /dev/vdb
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Attempting to detach device vdb from instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:48:32 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:48:32 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:48:32 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:48:32 user nova-compute[72810]:   <serial>4fa54af0-79ce-437f-bf2b-5484c2a7ab71</serial>
Jul 31 18:48:32 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:48:32 user nova-compute[72810]: </disk>
Jul 31 18:48:32 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:48:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe from the persistent domain config.
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:48:32 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:48:32 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:48:32 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:48:32 user nova-compute[72810]:   <serial>4fa54af0-79ce-437f-bf2b-5484c2a7ab71</serial>
Jul 31 18:48:32 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:48:32 user nova-compute[72810]: </disk>
Jul 31 18:48:32 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:48:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829313.1737976, dafaded3-47bf-416a-9b3e-c77fbd5e62fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:48:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe from the live domain config.
Jul 31 18:48:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmbLVdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:33 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f34326-68b6-4c90-bde2-8d80f2fff5b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7623f5aa-4688-462c-b0fb-5aa2e61481f8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:33 user nova-compute[72810]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)
Jul 31 18:48:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:33 user nova-compute[72810]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 (non-flash)
Jul 31 18:48:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4126200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed8b9a-3a3a-463a-b3d8-debb1ce49dc3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b1de46-c85b-40c6-9b29-98af898f60eb]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1b462-5a91-4566-be15-8c4160cdbc13]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c2dc6-5208-4f31-87db-4b0d2028067e]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df2885a-0b47-4b3e-ac51-98cd50de2861]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260204a-fe60-4c6d-a30a-9c5a7c8d630e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260]
Jul 31 18:48:33 user nova-compute[72810]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71, portal: 172.16.0.220,3260] successful.
Jul 31 18:48:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa54af0-79ce-437f-bf2b-5484c2a7ab71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eab5b2-7999-4f6e-ad38-1ed3eb1fa23d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== disconnect_volume: return (280ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:48:34 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b27fd3e0-da63-419d-9b48-f53285d63602 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:48:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Creating image(s)
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Ensure instance console log exists: /opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start _get_guest_xml network_info=[{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d000a70-0038-4b61-a514-694a492372a7', 'attached_at': '', 'detached_at': '', 'volume_id': '048e03ab-5ec8-440a-8ba0-cff75772ef83', 'serial': '048e03ab-5ec8-440a-8ba0-cff75772ef83'}, 'attachment_id': '9a360bec-ab0c-497c-987a-2b3ff377c38a', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:48:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:48:37 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:37 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:48:37 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f1b602-04cb-4d20-94ac-3c60be7c7a8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:48:37 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b63844-e44d-446e-8dd9-89f2baa84cd6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83] added
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e72af-9f92-40ea-90e5-2e1408df18b0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[081683fb-5143-4fb8-a99a-1c72c2598691]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjntpELw {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjntpELw" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da2474-fb85-4262-98f7-241bea020cd6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjntpELw'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d0f24-9cc5-45e1-b827-af8806a1b6be]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4170e3-3a99-4641-bdfa-fff4e7a2e7d4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56246755-9f1e-4f50-ad7b-600a82a6ac0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]
Jul 31 18:48:37 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78298c8-392e-4484-9db9-2cde08a6d6c4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9223ec6c-90e6-45c2-abb5-3be115044805]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:37 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:48:37 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:48:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d43dd6-5058-4c95-8f3f-0af3ff2ce64b]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:48:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23962363934663231', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363934663231', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:48:38 user nova-compute[72810]:   <uuid>8d000a70-0038-4b61-a514-694a492372a7</uuid>
Jul 31 18:48:38 user nova-compute[72810]:   <name>instance-00000019</name>
Jul 31 18:48:38 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:48:38 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:48:38 user nova-compute[72810]:   <metadata>
Jul 31 18:48:38 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:48:38 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:48:38 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherA-server-658508307</nova:name>
Jul 31 18:48:38 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:48:37</nova:creationTime>
Jul 31 18:48:38 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:48:38 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:48:38 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:48:38 user nova-compute[72810]:       <nova:owner>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:user uuid="a818426c4f424127a01cb9f57e076603">tempest-ServerActionsTestOtherA-1074391512-project-member</nova:user>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:project uuid="38248d933d4d42a9aca885b10fbd1afa">tempest-ServerActionsTestOtherA-1074391512</nova:project>
Jul 31 18:48:38 user nova-compute[72810]:       </nova:owner>
Jul 31 18:48:38 user nova-compute[72810]:       <nova:ports>
Jul 31 18:48:38 user nova-compute[72810]:         <nova:port uuid="2d7abd07-ce56-49ef-860e-be4aab4c2841">
Jul 31 18:48:38 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 18:48:38 user nova-compute[72810]:         </nova:port>
Jul 31 18:48:38 user nova-compute[72810]:       </nova:ports>
Jul 31 18:48:38 user nova-compute[72810]:     </nova:instance>
Jul 31 18:48:38 user nova-compute[72810]:   </metadata>
Jul 31 18:48:38 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:48:38 user nova-compute[72810]:     <system>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="serial">8d000a70-0038-4b61-a514-694a492372a7</entry>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="uuid">8d000a70-0038-4b61-a514-694a492372a7</entry>
Jul 31 18:48:38 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:48:38 user nova-compute[72810]:     </system>
Jul 31 18:48:38 user nova-compute[72810]:   </sysinfo>
Jul 31 18:48:38 user nova-compute[72810]:   <os>
Jul 31 18:48:38 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:48:38 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:48:38 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:48:38 user nova-compute[72810]:   </os>
Jul 31 18:48:38 user nova-compute[72810]:   <features>
Jul 31 18:48:38 user nova-compute[72810]:     <acpi/>
Jul 31 18:48:38 user nova-compute[72810]:     <apic/>
Jul 31 18:48:38 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:48:38 user nova-compute[72810]:   </features>
Jul 31 18:48:38 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:48:38 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:48:38 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:48:38 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:48:38 user nova-compute[72810]:   </clock>
Jul 31 18:48:38 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:48:38 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:48:38 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:48:38 user nova-compute[72810]:   </cpu>
Jul 31 18:48:38 user nova-compute[72810]:   <devices>
Jul 31 18:48:38 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:48:38 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:48:38 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:48:38 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:48:38 user nova-compute[72810]:       <serial>048e03ab-5ec8-440a-8ba0-cff75772ef83</serial>
Jul 31 18:48:38 user nova-compute[72810]:     </disk>
Jul 31 18:48:38 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:48:38 user nova-compute[72810]:       <mac address="fa:16:3e:09:27:db"/>
Jul 31 18:48:38 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:38 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:48:38 user nova-compute[72810]:       <target dev="tap2d7abd07-ce"/>
Jul 31 18:48:38 user nova-compute[72810]:     </interface>
Jul 31 18:48:38 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:48:38 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7/console.log" append="off"/>
Jul 31 18:48:38 user nova-compute[72810]:     </serial>
Jul 31 18:48:38 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:48:38 user nova-compute[72810]:     <video>
Jul 31 18:48:38 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:38 user nova-compute[72810]:     </video>
Jul 31 18:48:38 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:48:38 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:48:38 user nova-compute[72810]:     </rng>
Jul 31 18:48:38 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:48:38 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:48:38 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:48:38 user nova-compute[72810]:     </memballoon>
Jul 31 18:48:38 user nova-compute[72810]:   </devices>
Jul 31 18:48:38 user nova-compute[72810]: </domain>
Jul 31 18:48:38 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG os_vif [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d7abd07-ce, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d7abd07-ce, col_values=(('external_ids', {'iface-id': '2d7abd07-ce56-49ef-860e-be4aab4c2841', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:27:db', 'vm-uuid': '8d000a70-0038-4b61-a514-694a492372a7'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:38 user nova-compute[72810]: INFO os_vif [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce')
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No VIF found with MAC fa:16:3e:09:27:db, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829305.326778, 8dc56ab6-c880-4078-9bfb-4b2089655c9f => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:40 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] VM Stopped (Lifecycle Event)
Jul 31 18:48:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8b269fe5-6db6-4bc3-954f-e0323c18ecc3 None None] [instance: 8dc56ab6-c880-4078-9bfb-4b2089655c9f] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:40 user nova-compute[72810]: WARNING nova.compute.manager [req-e725cfc9-a755-4bf8-8c09-b33f9fa9ef35 req-b66a2c3b-7cda-4bed-bc51-b726a68075c0 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state building and task_state spawning.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829322.4092808, 8d000a70-0038-4b61-a514-694a492372a7 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Resumed (Lifecycle Event)
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance spawned successfully.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829322.412175, 8d000a70-0038-4b61-a514-694a492372a7 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Started (Lifecycle Event)
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:42 user nova-compute[72810]: WARNING nova.compute.manager [req-a3bbe226-20f6-4dff-a0b6-ef3f9a60b92a req-5f98042b-85bd-484d-a1e0-beb2ca07d2dd service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state building and task_state spawning.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Took 5.26 seconds to spawn the instance on the hypervisor.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:42 user nova-compute[72810]: INFO nova.compute.manager [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Took 14.87 seconds to build instance.
Jul 31 18:48:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-59071ba5-da46-416d-862b-bffeb703ae90 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.046s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:48:44 user nova-compute[72810]: INFO nova.compute.claims [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Claim successful on node user
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:48:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.policy [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5682f35ef70a4d85ac694eaee676c4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '331edd1d741f45708524dece1d4879c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:48:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Creating image(s)
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.192s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk 1073741824" returned: 0 in 0.052s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Cannot resize image /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'migration_context' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Ensure instance console log exists: /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Successfully created port: 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Successfully updated port: 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing instance network info cache due to event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance network_info: |[{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start _get_guest_xml network_info=[{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:48:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1640869050',display_name='tempest-ServerStableDeviceRescueTest-server-1640869050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1640869050',id=26,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjq/9hLgIc/BWvoj3i2M2iVNz9YZ0FWCqbG4fqtwtY0wKc3glxTBL4Kcpisq2xQNjkM33Wav55i/Dwmwocj54DMI42AqFyXOq7+lloEhjjhJNw33RyncuYvha+OlgRzpA==',key_name='tempest-keypair-121170053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='331edd1d741f45708524dece1d4879c2',ramdisk_id='',reservation_id='r-sb1pgzt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1101694858',owner_user_name='tempest-ServerStableDeviceRescueTest-1101694858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5682f35ef70a4d85ac694eaee676c4f3',uuid=efede298-b109-4259-af3d-beb9cdca7f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converting VIF {"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'pci_devices' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:48:47 user nova-compute[72810]:   <uuid>efede298-b109-4259-af3d-beb9cdca7f6c</uuid>
Jul 31 18:48:47 user nova-compute[72810]:   <name>instance-0000001a</name>
Jul 31 18:48:47 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:48:47 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:48:47 user nova-compute[72810]:   <metadata>
Jul 31 18:48:47 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:48:47 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1640869050</nova:name>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:48:47</nova:creationTime>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:48:47 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:48:47 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:owner>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:user uuid="5682f35ef70a4d85ac694eaee676c4f3">tempest-ServerStableDeviceRescueTest-1101694858-project-member</nova:user>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:project uuid="331edd1d741f45708524dece1d4879c2">tempest-ServerStableDeviceRescueTest-1101694858</nova:project>
Jul 31 18:48:47 user nova-compute[72810]:       </nova:owner>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:48:47 user nova-compute[72810]:       <nova:ports>
Jul 31 18:48:47 user nova-compute[72810]:         <nova:port uuid="49ac8945-2c3b-4732-8c63-e2fbce057f76">
Jul 31 18:48:47 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 18:48:47 user nova-compute[72810]:         </nova:port>
Jul 31 18:48:47 user nova-compute[72810]:       </nova:ports>
Jul 31 18:48:47 user nova-compute[72810]:     </nova:instance>
Jul 31 18:48:47 user nova-compute[72810]:   </metadata>
Jul 31 18:48:47 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:48:47 user nova-compute[72810]:     <system>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="serial">efede298-b109-4259-af3d-beb9cdca7f6c</entry>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="uuid">efede298-b109-4259-af3d-beb9cdca7f6c</entry>
Jul 31 18:48:47 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:48:47 user nova-compute[72810]:     </system>
Jul 31 18:48:47 user nova-compute[72810]:   </sysinfo>
Jul 31 18:48:47 user nova-compute[72810]:   <os>
Jul 31 18:48:47 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:48:47 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:48:47 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:48:47 user nova-compute[72810]:   </os>
Jul 31 18:48:47 user nova-compute[72810]:   <features>
Jul 31 18:48:47 user nova-compute[72810]:     <acpi/>
Jul 31 18:48:47 user nova-compute[72810]:     <apic/>
Jul 31 18:48:47 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:48:47 user nova-compute[72810]:   </features>
Jul 31 18:48:47 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:48:47 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:48:47 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:48:47 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:48:47 user nova-compute[72810]:   </clock>
Jul 31 18:48:47 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:48:47 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:48:47 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:48:47 user nova-compute[72810]:   </cpu>
Jul 31 18:48:47 user nova-compute[72810]:   <devices>
Jul 31 18:48:47 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:48:47 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:48:47 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk"/>
Jul 31 18:48:47 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:48:47 user nova-compute[72810]:     </disk>
Jul 31 18:48:47 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:48:47 user nova-compute[72810]:       <mac address="fa:16:3e:36:17:be"/>
Jul 31 18:48:47 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:47 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:48:47 user nova-compute[72810]:       <target dev="tap49ac8945-2c"/>
Jul 31 18:48:47 user nova-compute[72810]:     </interface>
Jul 31 18:48:47 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:48:47 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/console.log" append="off"/>
Jul 31 18:48:47 user nova-compute[72810]:     </serial>
Jul 31 18:48:47 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:48:47 user nova-compute[72810]:     <video>
Jul 31 18:48:47 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:47 user nova-compute[72810]:     </video>
Jul 31 18:48:47 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:48:47 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:48:47 user nova-compute[72810]:     </rng>
Jul 31 18:48:47 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:48:47 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:48:47 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:48:47 user nova-compute[72810]:     </memballoon>
Jul 31 18:48:47 user nova-compute[72810]:   </devices>
Jul 31 18:48:47 user nova-compute[72810]: </domain>
Jul 31 18:48:47 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1640869050',display_name='tempest-ServerStableDeviceRescueTest-server-1640869050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1640869050',id=26,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjq/9hLgIc/BWvoj3i2M2iVNz9YZ0FWCqbG4fqtwtY0wKc3glxTBL4Kcpisq2xQNjkM33Wav55i/Dwmwocj54DMI42AqFyXOq7+lloEhjjhJNw33RyncuYvha+OlgRzpA==',key_name='tempest-keypair-121170053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='331edd1d741f45708524dece1d4879c2',ramdisk_id='',reservation_id='r-sb1pgzt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1101694858',owner_user_name='tempest-ServerStableDeviceRescueTest-1101694858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5682f35ef70a4d85ac694eaee676c4f3',uuid=efede298-b109-4259-af3d-beb9cdca7f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converting VIF {"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG os_vif [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49ac8945-2c, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49ac8945-2c, col_values=(('external_ids', {'iface-id': '49ac8945-2c3b-4732-8c63-e2fbce057f76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:17:be', 'vm-uuid': 'efede298-b109-4259-af3d-beb9cdca7f6c'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:47 user nova-compute[72810]: INFO os_vif [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c')
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No VIF found with MAC fa:16:3e:36:17:be, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updated VIF entry in instance network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ff97fe2-61a9-4d79-8497-5c7b72bd501b req-dc01fbe8-7e93-496f-bedc-11c9c20d7688 service nova] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:48:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:48:48 user nova-compute[72810]: INFO nova.compute.claims [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Claim successful on node user
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:48:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:48 user nova-compute[72810]: WARNING nova.compute.manager [req-2e98d7c8-07cb-423c-8a2f-6b111320957b req-c6ff08a1-b03b-4762-b19d-bd942571d93d service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state building and task_state spawning.
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:48:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Creating image(s)
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "/opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "/opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "/opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.policy [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7e717c7bc3f444bacddaaa30a1c46fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1c84500e27412d96ee1665bfd41a5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.205s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk 1073741824" returned: 0 in 0.048s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Cannot resize image /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lazy-loading 'migration_context' on Instance uuid 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Ensure instance console log exists: /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:49 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Successfully created port: 27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Successfully updated port: 27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquired lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-changed-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Refreshing instance network info cache due to event network-changed-27150ea6-cf83-4e15-b6af-915a1583fecc. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] Acquiring lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:50 user nova-compute[72810]: WARNING nova.compute.manager [req-d50e8efe-c908-4fb7-8fee-8ba1d3486bf2 req-319252ae-e464-412c-b5b0-190e9f72cbfc service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state building and task_state spawning.
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Updating instance_info_cache with network_info: [{"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829330.991112, efede298-b109-4259-af3d-beb9cdca7f6c => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:50 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Resumed (Lifecycle Event)
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:48:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Releasing lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Instance network_info: |[{"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] Acquired lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Refreshing network info cache for port 27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Start _get_guest_xml network_info=[{"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance spawned successfully.
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:48:51 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:51 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-489895522',display_name='tempest-VolumesNegativeTest-instance-489895522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-489895522',id=27,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1c84500e27412d96ee1665bfd41a5b',ramdisk_id='',reservation_id='r-3i039ppw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1032305804',owner_user_name='tempest-VolumesNegativeTest-1032305804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:49Z,user_data=None,user_id='b7e717c7bc3f444bacddaaa30a1c46fc',uuid=4301cfd5-6e4d-4f09-a712-1d2a6c1722e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converting VIF {"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lazy-loading 'pci_devices' on Instance uuid 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829330.9966333, efede298-b109-4259-af3d-beb9cdca7f6c => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Started (Lifecycle Event)
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:48:51 user nova-compute[72810]:   <uuid>4301cfd5-6e4d-4f09-a712-1d2a6c1722e6</uuid>
Jul 31 18:48:51 user nova-compute[72810]:   <name>instance-0000001b</name>
Jul 31 18:48:51 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:48:51 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:48:51 user nova-compute[72810]:   <metadata>
Jul 31 18:48:51 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:48:51 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:name>tempest-VolumesNegativeTest-instance-489895522</nova:name>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:48:51</nova:creationTime>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:48:51 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:48:51 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:owner>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:user uuid="b7e717c7bc3f444bacddaaa30a1c46fc">tempest-VolumesNegativeTest-1032305804-project-member</nova:user>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:project uuid="8f1c84500e27412d96ee1665bfd41a5b">tempest-VolumesNegativeTest-1032305804</nova:project>
Jul 31 18:48:51 user nova-compute[72810]:       </nova:owner>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:48:51 user nova-compute[72810]:       <nova:ports>
Jul 31 18:48:51 user nova-compute[72810]:         <nova:port uuid="27150ea6-cf83-4e15-b6af-915a1583fecc">
Jul 31 18:48:51 user nova-compute[72810]:           <nova:ip type="fixed" address="192.168.233.235" ipVersion="4"/>
Jul 31 18:48:51 user nova-compute[72810]:         </nova:port>
Jul 31 18:48:51 user nova-compute[72810]:       </nova:ports>
Jul 31 18:48:51 user nova-compute[72810]:     </nova:instance>
Jul 31 18:48:51 user nova-compute[72810]:   </metadata>
Jul 31 18:48:51 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:48:51 user nova-compute[72810]:     <system>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="serial">4301cfd5-6e4d-4f09-a712-1d2a6c1722e6</entry>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="uuid">4301cfd5-6e4d-4f09-a712-1d2a6c1722e6</entry>
Jul 31 18:48:51 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:48:51 user nova-compute[72810]:     </system>
Jul 31 18:48:51 user nova-compute[72810]:   </sysinfo>
Jul 31 18:48:51 user nova-compute[72810]:   <os>
Jul 31 18:48:51 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:48:51 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:48:51 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:48:51 user nova-compute[72810]:   </os>
Jul 31 18:48:51 user nova-compute[72810]:   <features>
Jul 31 18:48:51 user nova-compute[72810]:     <acpi/>
Jul 31 18:48:51 user nova-compute[72810]:     <apic/>
Jul 31 18:48:51 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:48:51 user nova-compute[72810]:   </features>
Jul 31 18:48:51 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:48:51 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:48:51 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:48:51 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:48:51 user nova-compute[72810]:   </clock>
Jul 31 18:48:51 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:48:51 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:48:51 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:48:51 user nova-compute[72810]:   </cpu>
Jul 31 18:48:51 user nova-compute[72810]:   <devices>
Jul 31 18:48:51 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:48:51 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:48:51 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk"/>
Jul 31 18:48:51 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:48:51 user nova-compute[72810]:     </disk>
Jul 31 18:48:51 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:48:51 user nova-compute[72810]:       <mac address="fa:16:3e:ac:86:a6"/>
Jul 31 18:48:51 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:51 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:48:51 user nova-compute[72810]:       <target dev="tap27150ea6-cf"/>
Jul 31 18:48:51 user nova-compute[72810]:     </interface>
Jul 31 18:48:51 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:48:51 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/console.log" append="off"/>
Jul 31 18:48:51 user nova-compute[72810]:     </serial>
Jul 31 18:48:51 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:48:51 user nova-compute[72810]:     <video>
Jul 31 18:48:51 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:48:51 user nova-compute[72810]:     </video>
Jul 31 18:48:51 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:48:51 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:48:51 user nova-compute[72810]:     </rng>
Jul 31 18:48:51 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:48:51 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:48:51 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:48:51 user nova-compute[72810]:     </memballoon>
Jul 31 18:48:51 user nova-compute[72810]:   </devices>
Jul 31 18:48:51 user nova-compute[72810]: </domain>
Jul 31 18:48:51 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-489895522',display_name='tempest-VolumesNegativeTest-instance-489895522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-489895522',id=27,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1c84500e27412d96ee1665bfd41a5b',ramdisk_id='',reservation_id='r-3i039ppw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1032305804',owner_user_name='tempest-VolumesNegativeTest-1032305804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:49Z,user_data=None,user_id='b7e717c7bc3f444bacddaaa30a1c46fc',uuid=4301cfd5-6e4d-4f09-a712-1d2a6c1722e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converting VIF {"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG os_vif [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27150ea6-cf, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27150ea6-cf, col_values=(('external_ids', {'iface-id': '27150ea6-cf83-4e15-b6af-915a1583fecc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:86:a6', 'vm-uuid': '4301cfd5-6e4d-4f09-a712-1d2a6c1722e6'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:51 user nova-compute[72810]: INFO os_vif [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf')
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Took 6.37 seconds to spawn the instance on the hypervisor.
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] No VIF found with MAC fa:16:3e:ac:86:a6, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:48:51 user nova-compute[72810]: INFO nova.compute.manager [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Took 7.30 seconds to build instance.
Jul 31 18:48:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ab7b9845-734d-4e31-bf5d-45650647343a tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.397s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Updated VIF entry in instance network info cache for port 27150ea6-cf83-4e15-b6af-915a1583fecc. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Updating instance_info_cache with network_info: [{"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:48:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6a5a508b-4ca6-4e3e-84e4-40fed5bed826 req-623d26e0-bc27-46ee-a176-2fd0ca92867d service nova] Releasing lock "refresh_cache-4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:48:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] No waiting events found dispatching network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:53 user nova-compute[72810]: WARNING nova.compute.manager [req-2f17395d-0003-47c8-9f77-0cb890acc9e7 req-d9abe290-7d61-46f9-be84-0dc1704d32c0 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received unexpected event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc for instance with vm_state building and task_state spawning.
Jul 31 18:48:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829335.0347443, 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] VM Resumed (Lifecycle Event)
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Instance spawned successfully.
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829335.036375, 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] VM Started (Lifecycle Event)
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Took 6.20 seconds to spawn the instance on the hypervisor.
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] No waiting events found dispatching network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:48:55 user nova-compute[72810]: WARNING nova.compute.manager [req-08a6d265-25ba-409b-aa06-f2f59db0921b req-4935727a-4bc9-466e-be37-303ba29aa3c6 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received unexpected event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc for instance with vm_state building and task_state spawning.
Jul 31 18:48:55 user nova-compute[72810]: INFO nova.compute.manager [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Took 7.28 seconds to build instance.
Jul 31 18:48:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e2c5bbd5-98da-488b-9b09-0651f631fca1 tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.436s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:48:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:48:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.compute.manager [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-changed-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.compute.manager [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing instance network info cache due to event network-changed-8b8193bd-fbe0-4488-ad06-dfa1c6228290. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.network.neutron [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing network info cache for port 8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.network.neutron [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updated VIF entry in instance network info cache for port 8b8193bd-fbe0-4488-ad06-dfa1c6228290. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.network.neutron [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d8a3bddf-4486-4130-baea-628a60c6e394 req-e48e7869-4b65-4d87-bc95-6c2ae76e32b9 service nova] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'flavor' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'pci_requests' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:12 user nova-compute[72810]: DEBUG nova.network.neutron [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG nova.policy [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b0dae9e132b4e198e799027ab8049ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315ad01892ad4ea3bb90546e22b0c25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Successfully created port: 9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Successfully updated port: 9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-changed-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing instance network info cache due to event network-changed-9de27ebd-5366-4771-869d-642cbc494383. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:49:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Refreshing network info cache for port 9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG os_vif [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9de27ebd-53, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9de27ebd-53, col_values=(('external_ids', {'iface-id': '9de27ebd-5366-4771-869d-642cbc494383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b8:7d', 'vm-uuid': '197c109a-6ba4-4e9a-a177-801f3342a23d'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: INFO os_vif [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53')
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] attach device xml: <interface type="ethernet">
Jul 31 18:49:15 user nova-compute[72810]:   <mac address="fa:16:3e:c8:b8:7d"/>
Jul 31 18:49:15 user nova-compute[72810]:   <model type="virtio"/>
Jul 31 18:49:15 user nova-compute[72810]:   <mtu size="1442"/>
Jul 31 18:49:15 user nova-compute[72810]:   <target dev="tap9de27ebd-53"/>
Jul 31 18:49:15 user nova-compute[72810]: </interface>
Jul 31 18:49:15 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:15 user nova-compute[72810]: WARNING nova.compute.manager [req-9606bc38-f0dc-40fc-9c4a-6f74057e0a72 req-94205538-9230-4cbd-a309-cc3892d5a8b8 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 for instance with vm_state active and task_state None.
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updated VIF entry in instance network info cache for port 9de27ebd-5366-4771-869d-642cbc494383. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name hda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No VIF found with MAC fa:16:3e:e6:ac:ce, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecb9d6c8-7365-4fe5-990c-f61d9844ff5d req-f3f10c9c-cfbf-45b9-99a3-7ce582c42fd3 service nova] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:49:16 user nova-compute[72810]:   <nova:package version="0.0.0"/>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:name>tempest-device-tagging-server-292821082</nova:name>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:creationTime>2023-07-31 18:49:16</nova:creationTime>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:flavor name="m1.tiny">
Jul 31 18:49:16 user nova-compute[72810]:     <nova:memory>512</nova:memory>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:disk>1</nova:disk>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:swap>0</nova:swap>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:vcpus>1</nova:vcpus>
Jul 31 18:49:16 user nova-compute[72810]:   </nova:flavor>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:owner>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:user uuid="8b0dae9e132b4e198e799027ab8049ab">tempest-TaggedAttachmentsTest-1677977488-project-member</nova:user>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:project uuid="315ad01892ad4ea3bb90546e22b0c25e">tempest-TaggedAttachmentsTest-1677977488</nova:project>
Jul 31 18:49:16 user nova-compute[72810]:   </nova:owner>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:49:16 user nova-compute[72810]:   <nova:ports>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:port uuid="8b8193bd-fbe0-4488-ad06-dfa1c6228290">
Jul 31 18:49:16 user nova-compute[72810]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:49:16 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:16 user nova-compute[72810]:     <nova:port uuid="9de27ebd-5366-4771-869d-642cbc494383">
Jul 31 18:49:16 user nova-compute[72810]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 31 18:49:16 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:16 user nova-compute[72810]:   </nova:ports>
Jul 31 18:49:16 user nova-compute[72810]: </nova:instance>
Jul 31 18:49:16 user nova-compute[72810]:  {{(pid=72810) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-23c83c90-0a1b-4db6-a25d-44b0c12fcdc4 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.388s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:16 user nova-compute[72810]: INFO nova.compute.manager [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Terminating instance
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'flavor' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:49:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=6791MB free_disk=25.41321563720703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:17 user nova-compute[72810]: INFO nova.compute.manager [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Attaching volume 6ab1d4e8-881d-4092-afbd-36f14dd7350f to /dev/vdb
Jul 31 18:49:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Instance destroyed successfully.
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'resources' on Instance uuid c7aebd74-38c4-4925-8723-9d88596169cb {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2077908289',display_name='tempest-AttachVolumeTestJSON-server-2077908289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2077908289',id=8,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ziFBdMHN40RK+CPC2CUGANzI1dcXvlkkf+AskMFvamkmBr+n4yYaAZik5w6K/TK3HCh8Plsy+vL9tlxEEemPSajunWRcH5T4n+ZyntUuIvPxWJ8Q/W0BgcBkaAOjXEw==',key_name='tempest-keypair-1439920862',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-aa944sl7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=c7aebd74-38c4-4925-8723-9d88596169cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "address": "fa:16:3e:ed:6c:7c", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0013d9f-8a", "ovs_interfaceid": "e0013d9f-8ad7-4d9e-8874-6987d6db9c9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_vif [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0013d9f-8a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:49:17 user nova-compute[72810]: INFO os_vif [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:6c:7c,bridge_name='br-int',has_traffic_filtering=True,id=e0013d9f-8ad7-4d9e-8874-6987d6db9c9c,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0013d9f-8a')
Jul 31 18:49:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Deleting instance files /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb_del
Jul 31 18:49:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Deletion of /opt/stack/data/nova/instances/c7aebd74-38c4-4925-8723-9d88596169cb_del complete
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.utils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e72ab-3b53-40db-85fd-cbb644fb83a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c644c02c-3f11-494a-be79-a63914403792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:17 user nova-compute[72810]: INFO nova.compute.manager [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Took 1.36 seconds to destroy the instance on the hypervisor.
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1269f2a5-6873-4c14-a5c5-73c54811e622]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beb78e1-8383-40a5-b702-c189c5e8b9a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c7aebd74-38c4-4925-8723-9d88596169cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 197c109a-6ba4-4e9a-a177-801f3342a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0ac70112-5aaf-493c-b810-3ad743b483e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:17 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcef518-47a7-491e-9303-a01391640511]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG os_brick.utils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating existing volume attachment record: fd5d0938-d176-45ad-9d0e-0b1f2980fdcd {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:17 user nova-compute[72810]: WARNING nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 for instance with vm_state active and task_state None.
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-unplugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Acquiring lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] Lock "c7aebd74-38c4-4925-8723-9d88596169cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] No waiting events found dispatching network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:17 user nova-compute[72810]: WARNING nova.compute.manager [req-eb000d52-3224-44c8-b84f-50e166fdd0e4 req-5b0b1a1a-4c7a-48bb-877f-44a3facd034a service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received unexpected event network-vif-plugged-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c for instance with vm_state active and task_state deleting.
Jul 31 18:49:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Took 1.00 seconds to deallocate network for instance.
Jul 31 18:49:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-4f8eec01-39a1-4f45-833e-f8a1fab869b0 req-442fce17-65ec-4d06-b2d1-b86f634c0f60 service nova] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Received event network-vif-deleted-e0013d9f-8ad7-4d9e-8874-6987d6db9c9c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:19 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:49:19 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:49:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:19 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Deleted allocations for instance c7aebd74-38c4-4925-8723-9d88596169cb
Jul 31 18:49:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0e58019e-3cfb-4e06-9146-c57d88f6a7bf tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "c7aebd74-38c4-4925-8723-9d88596169cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:49:21 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:49:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:23 user nova-compute[72810]: INFO nova.compute.manager [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Terminating instance
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-unplugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] No waiting events found dispatching network-vif-unplugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-137ccad5-87f3-48fa-80fc-fb341c4f453b req-ebc02686-bb11-4bb0-a4db-58f84985fef4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-unplugged-82000850-85e0-44f8-ba5d-d6f66d53c63e for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:49:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Instance destroyed successfully.
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.objects.instance [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'resources' on Instance uuid dafaded3-47bf-416a-9b3e-c77fbd5e62fe {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:46:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1953906713',display_name='tempest-AttachVolumeNegativeTest-server-1953906713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1953906713',id=20,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYCe4bVomqXo4KoBRwbJ4mzVTujgyDN9kOGuUJdgbkGwjTpDJ1GZUsmsf9uX48H5VYlqxJR0QdbAg3iiG3hHP40CwbzOsT7Ul+ICSE1mcncZBsMUsAZbd5NjNn4y8PHCw==',key_name='tempest-keypair-944576963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:46:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-w8jiyvxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=dafaded3-47bf-416a-9b3e-c77fbd5e62fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "address": "fa:16:3e:23:ce:20", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82000850-85", "ovs_interfaceid": "82000850-85e0-44f8-ba5d-d6f66d53c63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG os_vif [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82000850-85, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:49:23 user nova-compute[72810]: INFO os_vif [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:ce:20,bridge_name='br-int',has_traffic_filtering=True,id=82000850-85e0-44f8-ba5d-d6f66d53c63e,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82000850-85')
Jul 31 18:49:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Deleting instance files /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe_del
Jul 31 18:49:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Deletion of /opt/stack/data/nova/instances/dafaded3-47bf-416a-9b3e-c77fbd5e62fe_del complete
Jul 31 18:49:23 user nova-compute[72810]: INFO nova.compute.manager [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 18:49:23 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:49:23 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:49:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-88fd2df6-8c16-4913-bcdf-8f99f90a88ef req-6cf097df-ee7f-458d-bc6d-908b37b7d7f4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-deleted-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:25 user nova-compute[72810]: INFO nova.compute.manager [req-88fd2df6-8c16-4913-bcdf-8f99f90a88ef req-6cf097df-ee7f-458d-bc6d-908b37b7d7f4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Neutron deleted interface 82000850-85e0-44f8-ba5d-d6f66d53c63e; detaching it from the instance and deleting it from the info cache
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-88fd2df6-8c16-4913-bcdf-8f99f90a88ef req-6cf097df-ee7f-458d-bc6d-908b37b7d7f4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-88fd2df6-8c16-4913-bcdf-8f99f90a88ef req-6cf097df-ee7f-458d-bc6d-908b37b7d7f4 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Detach interface failed, port_id=82000850-85e0-44f8-ba5d-d6f66d53c63e, reason: Instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:49:25 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Took 1.10 seconds to deallocate network for instance.
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] Acquiring lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] No waiting events found dispatching network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:25 user nova-compute[72810]: WARNING nova.compute.manager [req-eb23fbd8-c300-476a-892a-c8a7cf2e7f32 req-74c44546-18ec-42b3-9943-722a98ca7927 service nova] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Received unexpected event network-vif-plugged-82000850-85e0-44f8-ba5d-d6f66d53c63e for instance with vm_state deleted and task_state None.
Jul 31 18:49:25 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:25 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Deleted allocations for instance dafaded3-47bf-416a-9b3e-c77fbd5e62fe
Jul 31 18:49:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2cc246d5-baa2-4090-bf6f-a5657d62f751 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "dafaded3-47bf-416a-9b3e-c77fbd5e62fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.568s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBFfCnIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:26 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:49:26 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:49:26 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab89cbc-d691-4025-870a-9c032ee160c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:49:26 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61fd56-52f5-4fe5-91a5-73c8942c65a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f] added
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b5044c-2cdb-4abc-94f4-c83415e4505f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0ef7ef-e775-4a0f-a96c-382d42b466d1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBFfCnIl {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBFfCnIl" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f7467-94cf-461c-b1cc-0547ec81b890]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBFfCnIl'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fef76d5-5cb5-4406-8b61-8cde1f94e2b0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8226bb-0fab-4070-ab17-1aec966db94f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b28fdcd-578e-415d-8df4-7636b834ba7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260]
Jul 31 18:49:26 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260] successful.
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5f2fae-2ece-41d1-920c-a421f6acba38]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f61767-204b-425c-85f4-b93c72eb0a07]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:26 user nova-compute[72810]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)
Jul 31 18:49:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4161c2f6-0342-4930-b417-9a4a079c89c4]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:49:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBFfCnIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23762333361333165', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762333361333165', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.objects.instance [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'flavor' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:49:27 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:49:27 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:49:27 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:49:27 user nova-compute[72810]:   <serial>6ab1d4e8-881d-4092-afbd-36f14dd7350f</serial>
Jul 31 18:49:27 user nova-compute[72810]: </disk>
Jul 31 18:49:27 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No BDM found with device name hda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] No VIF found with MAC fa:16:3e:e6:ac:ce, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:49:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-741cfe56-a74c-4e49-ab4c-fb11d3a6eca8 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.453s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:29 user nova-compute[72810]: INFO nova.compute.manager [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Rescuing
Jul 31 18:49:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:29 user nova-compute[72810]: INFO nova.compute.manager [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Detaching volume 6ab1d4e8-881d-4092-afbd-36f14dd7350f
Jul 31 18:49:29 user nova-compute[72810]: INFO nova.virt.block_device [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Attempting to driver detach volume 6ab1d4e8-881d-4092-afbd-36f14dd7350f from mountpoint /dev/vdb
Jul 31 18:49:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Attempting to detach device vdb from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:49:29 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:49:29 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:49:29 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:49:29 user nova-compute[72810]:   <serial>6ab1d4e8-881d-4092-afbd-36f14dd7350f</serial>
Jul 31 18:49:29 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:49:29 user nova-compute[72810]: </disk>
Jul 31 18:49:29 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:49:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully detached device vdb from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the persistent domain config.
Jul 31 18:49:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:49:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:49:29 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:49:29 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:49:29 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:49:29 user nova-compute[72810]:   <serial>6ab1d4e8-881d-4092-afbd-36f14dd7350f</serial>
Jul 31 18:49:29 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:49:29 user nova-compute[72810]: </disk>
Jul 31 18:49:29 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:30 user nova-compute[72810]: WARNING nova.compute.manager [req-bf725cf0-3985-4a56-9ba5-5341e4adec12 req-dd1b21bb-1d56-4487-a860-a2c1b6f9b41a service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829370.4010937, 197c109a-6ba4-4e9a-a177-801f3342a23d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:49:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully detached device vdb from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the live domain config.
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBFfCnIl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97664cc-ba2c-4b83-8af6-a4782569579b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[607490aa-8fbe-4b5c-92b3-a54580761b08]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)
Jul 31 18:49:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f (non-flash)
Jul 31 18:49:30 user nova-compute[72810]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)
Jul 31 18:49:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4073f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d952495-e0d1-40b8-a719-fae9efbf6ed2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23d3264-9810-4497-84bf-251bb7d215a8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b62e56-0358-429d-b369-7cd2772576ff]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd1be5-fa4f-4b84-8a26-b8e3dbbe3127]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98d575-50e6-417c-b7cc-ec9d68a0a61b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c7b80a-e013-46e8-ba4b-521b85223e0d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260]
Jul 31 18:49:30 user nova-compute[72810]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f, portal: 172.16.0.220,3260] successful.
Jul 31 18:49:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ab1d4e8-881d-4092-afbd-36f14dd7350f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e31448-62b2-4040-bc72-5da899b06b8c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] <== disconnect_volume: return (327ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance destroyed successfully.
Jul 31 18:49:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Attempting a stable device rescue
Jul 31 18:49:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:49:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Creating image(s)
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'trusted_certs' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "df270d5e72704ee798e3dc06a2237960249dc01c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "df270d5e72704ee798e3dc06a2237960249dc01c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'flavor' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-9de27ebd-5366-4771-869d-642cbc494383" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-9de27ebd-5366-4771-869d-642cbc494383" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'flavor' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.part --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.images [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] 91b54b1c-c1b8-48f5-a1eb-4f68b097c796 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.part /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:32 user nova-compute[72810]: WARNING nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:32 user nova-compute[72810]: WARNING nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:32 user nova-compute[72810]: WARNING nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:32 user nova-compute[72810]: WARNING nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:32 user nova-compute[72810]: WARNING nova.compute.manager [req-642e5061-e348-4c2c-998a-35ec6484c184 req-6e6f9652-dfb3-48c3-8252-06d857bf3be2 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fe284f38-37dd-4f67-894c-75346fbd56ba tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.669s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface> {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface> {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Attempting to detach device tap9de27ebd-53 from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] detach device xml: <interface type="ethernet">
Jul 31 18:49:32 user nova-compute[72810]:   <mac address="fa:16:3e:c8:b8:7d"/>
Jul 31 18:49:32 user nova-compute[72810]:   <model type="virtio"/>
Jul 31 18:49:32 user nova-compute[72810]:   <mtu size="1442"/>
Jul 31 18:49:32 user nova-compute[72810]:   <target dev="tap9de27ebd-53"/>
Jul 31 18:49:32 user nova-compute[72810]: </interface>
Jul 31 18:49:32 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface> {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 31 18:49:32 user nova-compute[72810]:   <name>instance-00000015</name>
Jul 31 18:49:32 user nova-compute[72810]:   <uuid>197c109a-6ba4-4e9a-a177-801f3342a23d</uuid>
Jul 31 18:49:32 user nova-compute[72810]:   <metadata>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:49:32 user nova-compute[72810]:   <nova:package version="0.0.0"/>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:name>tempest-device-tagging-server-292821082</nova:name>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:creationTime>2023-07-31 18:49:16</nova:creationTime>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:flavor name="m1.tiny">
Jul 31 18:49:32 user nova-compute[72810]:     <nova:memory>512</nova:memory>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:disk>1</nova:disk>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:swap>0</nova:swap>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:vcpus>1</nova:vcpus>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:flavor>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:owner>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:user uuid="8b0dae9e132b4e198e799027ab8049ab">tempest-TaggedAttachmentsTest-1677977488-project-member</nova:user>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:project uuid="315ad01892ad4ea3bb90546e22b0c25e">tempest-TaggedAttachmentsTest-1677977488</nova:project>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:owner>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:ports>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:port uuid="8b8193bd-fbe0-4488-ad06-dfa1c6228290">
Jul 31 18:49:32 user nova-compute[72810]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:49:32 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:port uuid="9de27ebd-5366-4771-869d-642cbc494383">
Jul 31 18:49:32 user nova-compute[72810]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 31 18:49:32 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:ports>
Jul 31 18:49:32 user nova-compute[72810]: </nova:instance>
Jul 31 18:49:32 user nova-compute[72810]:   </metadata>
Jul 31 18:49:32 user nova-compute[72810]:   <memory unit='KiB'>524288</memory>
Jul 31 18:49:32 user nova-compute[72810]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 18:49:32 user nova-compute[72810]:   <vcpu placement='static'>1</vcpu>
Jul 31 18:49:32 user nova-compute[72810]:   <resource>
Jul 31 18:49:32 user nova-compute[72810]:     <partition>/machine</partition>
Jul 31 18:49:32 user nova-compute[72810]:   </resource>
Jul 31 18:49:32 user nova-compute[72810]:   <sysinfo type='smbios'>
Jul 31 18:49:32 user nova-compute[72810]:     <system>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='version'>0.0.0</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='serial'>197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='uuid'>197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='family'>Virtual Machine</entry>
Jul 31 18:49:32 user nova-compute[72810]:     </system>
Jul 31 18:49:32 user nova-compute[72810]:   </sysinfo>
Jul 31 18:49:32 user nova-compute[72810]:   <os>
Jul 31 18:49:32 user nova-compute[72810]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 18:49:32 user nova-compute[72810]:     <boot dev='hd'/>
Jul 31 18:49:32 user nova-compute[72810]:     <smbios mode='sysinfo'/>
Jul 31 18:49:32 user nova-compute[72810]:   </os>
Jul 31 18:49:32 user nova-compute[72810]:   <features>
Jul 31 18:49:32 user nova-compute[72810]:     <acpi/>
Jul 31 18:49:32 user nova-compute[72810]:     <apic/>
Jul 31 18:49:32 user nova-compute[72810]:     <vmcoreinfo state='on'/>
Jul 31 18:49:32 user nova-compute[72810]:   </features>
Jul 31 18:49:32 user nova-compute[72810]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 18:49:32 user nova-compute[72810]:     <model fallback='forbid'>Nehalem</model>
Jul 31 18:49:32 user nova-compute[72810]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='vme'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='x2apic'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='hypervisor'/>
Jul 31 18:49:32 user nova-compute[72810]:   </cpu>
Jul 31 18:49:32 user nova-compute[72810]:   <clock offset='utc'>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='hpet' present='no'/>
Jul 31 18:49:32 user nova-compute[72810]:   </clock>
Jul 31 18:49:32 user nova-compute[72810]:   <on_poweroff>destroy</on_poweroff>
Jul 31 18:49:32 user nova-compute[72810]:   <on_reboot>restart</on_reboot>
Jul 31 18:49:32 user nova-compute[72810]:   <on_crash>destroy</on_crash>
Jul 31 18:49:32 user nova-compute[72810]:   <devices>
Jul 31 18:49:32 user nova-compute[72810]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 18:49:32 user nova-compute[72810]:     <disk type='file' device='disk'>
Jul 31 18:49:32 user nova-compute[72810]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 18:49:32 user nova-compute[72810]:       <source file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk' index='2'/>
Jul 31 18:49:32 user nova-compute[72810]:       <backingStore type='file' index='3'>
Jul 31 18:49:32 user nova-compute[72810]:         <format type='raw'/>
Jul 31 18:49:32 user nova-compute[72810]:         <source file='/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781'/>
Jul 31 18:49:32 user nova-compute[72810]:         <backingStore/>
Jul 31 18:49:32 user nova-compute[72810]:       </backingStore>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='vda' bus='virtio'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='virtio-disk0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </disk>
Jul 31 18:49:32 user nova-compute[72810]:     <disk type='file' device='cdrom'>
Jul 31 18:49:32 user nova-compute[72810]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 18:49:32 user nova-compute[72810]:       <source file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config' index='1'/>
Jul 31 18:49:32 user nova-compute[72810]:       <backingStore/>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='hda' bus='ide'/>
Jul 31 18:49:32 user nova-compute[72810]:       <readonly/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='ide0-0-0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </disk>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='usb' index='0' model='none'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='usb'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='pci.0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='ide' index='0'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='ide'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <interface type='ethernet'>
Jul 31 18:49:32 user nova-compute[72810]:       <mac address='fa:16:3e:e6:ac:ce'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='tap8b8193bd-fb'/>
Jul 31 18:49:32 user nova-compute[72810]:       <model type='virtio'/>
Jul 31 18:49:32 user nova-compute[72810]:       <mtu size='1442'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='net0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </interface>
Jul 31 18:49:32 user nova-compute[72810]:     <interface type='ethernet'>
Jul 31 18:49:32 user nova-compute[72810]:       <mac address='fa:16:3e:c8:b8:7d'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='tap9de27ebd-53'/>
Jul 31 18:49:32 user nova-compute[72810]:       <model type='virtio'/>
Jul 31 18:49:32 user nova-compute[72810]:       <mtu size='1442'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='net1'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </interface>
Jul 31 18:49:32 user nova-compute[72810]:     <serial type='pty'>
Jul 31 18:49:32 user nova-compute[72810]:       <source path='/dev/pts/4'/>
Jul 31 18:49:32 user nova-compute[72810]:       <log file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log' append='off'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target type='isa-serial' port='0'>
Jul 31 18:49:32 user nova-compute[72810]:         <model name='isa-serial'/>
Jul 31 18:49:32 user nova-compute[72810]:       </target>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='serial0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </serial>
Jul 31 18:49:32 user nova-compute[72810]:     <console type='pty' tty='/dev/pts/4'>
Jul 31 18:49:32 user nova-compute[72810]:       <source path='/dev/pts/4'/>
Jul 31 18:49:32 user nova-compute[72810]:       <log file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log' append='off'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target type='serial' port='0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='serial0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </console>
Jul 31 18:49:32 user nova-compute[72810]:     <input type='mouse' bus='ps2'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='input0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </input>
Jul 31 18:49:32 user nova-compute[72810]:     <input type='keyboard' bus='ps2'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='input1'/>
Jul 31 18:49:32 user nova-compute[72810]:     </input>
Jul 31 18:49:32 user nova-compute[72810]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Jul 31 18:49:32 user nova-compute[72810]:       <listen type='address' address='0.0.0.0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </graphics>
Jul 31 18:49:32 user nova-compute[72810]:     <audio id='1' type='none'/>
Jul 31 18:49:32 user nova-compute[72810]:     <video>
Jul 31 18:49:32 user nova-compute[72810]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='video0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </video>
Jul 31 18:49:32 user nova-compute[72810]:     <memballoon model='virtio'>
Jul 31 18:49:32 user nova-compute[72810]:       <stats period='10'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='balloon0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </memballoon>
Jul 31 18:49:32 user nova-compute[72810]:     <rng model='virtio'>
Jul 31 18:49:32 user nova-compute[72810]:       <backend model='random'>/dev/urandom</backend>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='rng0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </rng>
Jul 31 18:49:32 user nova-compute[72810]:   </devices>
Jul 31 18:49:32 user nova-compute[72810]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 18:49:32 user nova-compute[72810]:     <label>libvirt-197c109a-6ba4-4e9a-a177-801f3342a23d</label>
Jul 31 18:49:32 user nova-compute[72810]:     <imagelabel>libvirt-197c109a-6ba4-4e9a-a177-801f3342a23d</imagelabel>
Jul 31 18:49:32 user nova-compute[72810]:   </seclabel>
Jul 31 18:49:32 user nova-compute[72810]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 18:49:32 user nova-compute[72810]:     <label>+64055:+108</label>
Jul 31 18:49:32 user nova-compute[72810]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 18:49:32 user nova-compute[72810]:   </seclabel>
Jul 31 18:49:32 user nova-compute[72810]: </domain>
Jul 31 18:49:32 user nova-compute[72810]:  {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 18:49:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully detached device tap9de27ebd-53 from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the persistent domain config.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] (1/8): Attempting to detach device tap9de27ebd-53 with device alias net1 from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] detach device xml: <interface type="ethernet">
Jul 31 18:49:32 user nova-compute[72810]:   <mac address="fa:16:3e:c8:b8:7d"/>
Jul 31 18:49:32 user nova-compute[72810]:   <model type="virtio"/>
Jul 31 18:49:32 user nova-compute[72810]:   <mtu size="1442"/>
Jul 31 18:49:32 user nova-compute[72810]:   <target dev="tap9de27ebd-53"/>
Jul 31 18:49:32 user nova-compute[72810]: </interface>
Jul 31 18:49:32 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829357.2756467, c7aebd74-38c4-4925-8723-9d88596169cb => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:49:32 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] VM Stopped (Lifecycle Event)
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-5e6e16fb-96ce-4245-a90d-2b6525f876f5 None None] [instance: c7aebd74-38c4-4925-8723-9d88596169cb] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.part /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.converted" returned: 0 in 0.361s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829372.9037695, 197c109a-6ba4-4e9a-a177-801f3342a23d => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Start waiting for the detach event from libvirt for device tap9de27ebd-53 with device alias net1 for instance 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface> {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:b8:7d"/><model type="virtio"/><mtu size="1442"/><target dev="tap9de27ebd-53"/></interface>not found in domain: <domain type='kvm' id='29'>
Jul 31 18:49:32 user nova-compute[72810]:   <name>instance-00000015</name>
Jul 31 18:49:32 user nova-compute[72810]:   <uuid>197c109a-6ba4-4e9a-a177-801f3342a23d</uuid>
Jul 31 18:49:32 user nova-compute[72810]:   <metadata>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:49:32 user nova-compute[72810]:   <nova:package version="0.0.0"/>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:name>tempest-device-tagging-server-292821082</nova:name>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:creationTime>2023-07-31 18:49:16</nova:creationTime>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:flavor name="m1.tiny">
Jul 31 18:49:32 user nova-compute[72810]:     <nova:memory>512</nova:memory>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:disk>1</nova:disk>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:swap>0</nova:swap>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:vcpus>1</nova:vcpus>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:flavor>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:owner>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:user uuid="8b0dae9e132b4e198e799027ab8049ab">tempest-TaggedAttachmentsTest-1677977488-project-member</nova:user>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:project uuid="315ad01892ad4ea3bb90546e22b0c25e">tempest-TaggedAttachmentsTest-1677977488</nova:project>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:owner>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:49:32 user nova-compute[72810]:   <nova:ports>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:port uuid="8b8193bd-fbe0-4488-ad06-dfa1c6228290">
Jul 31 18:49:32 user nova-compute[72810]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:49:32 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:32 user nova-compute[72810]:     <nova:port uuid="9de27ebd-5366-4771-869d-642cbc494383">
Jul 31 18:49:32 user nova-compute[72810]:       <nova:ip type="fixed" address="10.10.10.150" ipVersion="4"/>
Jul 31 18:49:32 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:32 user nova-compute[72810]:   </nova:ports>
Jul 31 18:49:32 user nova-compute[72810]: </nova:instance>
Jul 31 18:49:32 user nova-compute[72810]:   </metadata>
Jul 31 18:49:32 user nova-compute[72810]:   <memory unit='KiB'>524288</memory>
Jul 31 18:49:32 user nova-compute[72810]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 18:49:32 user nova-compute[72810]:   <vcpu placement='static'>1</vcpu>
Jul 31 18:49:32 user nova-compute[72810]:   <resource>
Jul 31 18:49:32 user nova-compute[72810]:     <partition>/machine</partition>
Jul 31 18:49:32 user nova-compute[72810]:   </resource>
Jul 31 18:49:32 user nova-compute[72810]:   <sysinfo type='smbios'>
Jul 31 18:49:32 user nova-compute[72810]:     <system>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='version'>0.0.0</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='serial'>197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='uuid'>197c109a-6ba4-4e9a-a177-801f3342a23d</entry>
Jul 31 18:49:32 user nova-compute[72810]:       <entry name='family'>Virtual Machine</entry>
Jul 31 18:49:32 user nova-compute[72810]:     </system>
Jul 31 18:49:32 user nova-compute[72810]:   </sysinfo>
Jul 31 18:49:32 user nova-compute[72810]:   <os>
Jul 31 18:49:32 user nova-compute[72810]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 18:49:32 user nova-compute[72810]:     <boot dev='hd'/>
Jul 31 18:49:32 user nova-compute[72810]:     <smbios mode='sysinfo'/>
Jul 31 18:49:32 user nova-compute[72810]:   </os>
Jul 31 18:49:32 user nova-compute[72810]:   <features>
Jul 31 18:49:32 user nova-compute[72810]:     <acpi/>
Jul 31 18:49:32 user nova-compute[72810]:     <apic/>
Jul 31 18:49:32 user nova-compute[72810]:     <vmcoreinfo state='on'/>
Jul 31 18:49:32 user nova-compute[72810]:   </features>
Jul 31 18:49:32 user nova-compute[72810]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 18:49:32 user nova-compute[72810]:     <model fallback='forbid'>Nehalem</model>
Jul 31 18:49:32 user nova-compute[72810]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='vme'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='x2apic'/>
Jul 31 18:49:32 user nova-compute[72810]:     <feature policy='require' name='hypervisor'/>
Jul 31 18:49:32 user nova-compute[72810]:   </cpu>
Jul 31 18:49:32 user nova-compute[72810]:   <clock offset='utc'>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 18:49:32 user nova-compute[72810]:     <timer name='hpet' present='no'/>
Jul 31 18:49:32 user nova-compute[72810]:   </clock>
Jul 31 18:49:32 user nova-compute[72810]:   <on_poweroff>destroy</on_poweroff>
Jul 31 18:49:32 user nova-compute[72810]:   <on_reboot>restart</on_reboot>
Jul 31 18:49:32 user nova-compute[72810]:   <on_crash>destroy</on_crash>
Jul 31 18:49:32 user nova-compute[72810]:   <devices>
Jul 31 18:49:32 user nova-compute[72810]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 18:49:32 user nova-compute[72810]:     <disk type='file' device='disk'>
Jul 31 18:49:32 user nova-compute[72810]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 18:49:32 user nova-compute[72810]:       <source file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk' index='2'/>
Jul 31 18:49:32 user nova-compute[72810]:       <backingStore type='file' index='3'>
Jul 31 18:49:32 user nova-compute[72810]:         <format type='raw'/>
Jul 31 18:49:32 user nova-compute[72810]:         <source file='/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781'/>
Jul 31 18:49:32 user nova-compute[72810]:         <backingStore/>
Jul 31 18:49:32 user nova-compute[72810]:       </backingStore>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='vda' bus='virtio'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='virtio-disk0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </disk>
Jul 31 18:49:32 user nova-compute[72810]:     <disk type='file' device='cdrom'>
Jul 31 18:49:32 user nova-compute[72810]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 18:49:32 user nova-compute[72810]:       <source file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk.config' index='1'/>
Jul 31 18:49:32 user nova-compute[72810]:       <backingStore/>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='hda' bus='ide'/>
Jul 31 18:49:32 user nova-compute[72810]:       <readonly/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='ide0-0-0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </disk>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='usb' index='0' model='none'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='usb'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='pci.0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <controller type='ide' index='0'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='ide'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 18:49:32 user nova-compute[72810]:     </controller>
Jul 31 18:49:32 user nova-compute[72810]:     <interface type='ethernet'>
Jul 31 18:49:32 user nova-compute[72810]:       <mac address='fa:16:3e:e6:ac:ce'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target dev='tap8b8193bd-fb'/>
Jul 31 18:49:32 user nova-compute[72810]:       <model type='virtio'/>
Jul 31 18:49:32 user nova-compute[72810]:       <mtu size='1442'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='net0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </interface>
Jul 31 18:49:32 user nova-compute[72810]:     <serial type='pty'>
Jul 31 18:49:32 user nova-compute[72810]:       <source path='/dev/pts/4'/>
Jul 31 18:49:32 user nova-compute[72810]:       <log file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log' append='off'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target type='isa-serial' port='0'>
Jul 31 18:49:32 user nova-compute[72810]:         <model name='isa-serial'/>
Jul 31 18:49:32 user nova-compute[72810]:       </target>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='serial0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </serial>
Jul 31 18:49:32 user nova-compute[72810]:     <console type='pty' tty='/dev/pts/4'>
Jul 31 18:49:32 user nova-compute[72810]:       <source path='/dev/pts/4'/>
Jul 31 18:49:32 user nova-compute[72810]:       <log file='/opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/console.log' append='off'/>
Jul 31 18:49:32 user nova-compute[72810]:       <target type='serial' port='0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='serial0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </console>
Jul 31 18:49:32 user nova-compute[72810]:     <input type='mouse' bus='ps2'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='input0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </input>
Jul 31 18:49:32 user nova-compute[72810]:     <input type='keyboard' bus='ps2'>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='input1'/>
Jul 31 18:49:32 user nova-compute[72810]:     </input>
Jul 31 18:49:32 user nova-compute[72810]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Jul 31 18:49:32 user nova-compute[72810]:       <listen type='address' address='0.0.0.0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </graphics>
Jul 31 18:49:32 user nova-compute[72810]:     <audio id='1' type='none'/>
Jul 31 18:49:32 user nova-compute[72810]:     <video>
Jul 31 18:49:32 user nova-compute[72810]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='video0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </video>
Jul 31 18:49:32 user nova-compute[72810]:     <memballoon model='virtio'>
Jul 31 18:49:32 user nova-compute[72810]:       <stats period='10'/>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='balloon0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </memballoon>
Jul 31 18:49:32 user nova-compute[72810]:     <rng model='virtio'>
Jul 31 18:49:32 user nova-compute[72810]:       <backend model='random'>/dev/urandom</backend>
Jul 31 18:49:32 user nova-compute[72810]:       <alias name='rng0'/>
Jul 31 18:49:32 user nova-compute[72810]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 18:49:32 user nova-compute[72810]:     </rng>
Jul 31 18:49:32 user nova-compute[72810]:   </devices>
Jul 31 18:49:32 user nova-compute[72810]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 18:49:32 user nova-compute[72810]:     <label>libvirt-197c109a-6ba4-4e9a-a177-801f3342a23d</label>
Jul 31 18:49:32 user nova-compute[72810]:     <imagelabel>libvirt-197c109a-6ba4-4e9a-a177-801f3342a23d</imagelabel>
Jul 31 18:49:32 user nova-compute[72810]:   </seclabel>
Jul 31 18:49:32 user nova-compute[72810]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 18:49:32 user nova-compute[72810]:     <label>+64055:+108</label>
Jul 31 18:49:32 user nova-compute[72810]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 18:49:32 user nova-compute[72810]:   </seclabel>
Jul 31 18:49:32 user nova-compute[72810]: </domain>
Jul 31 18:49:32 user nova-compute[72810]:  {{(pid=72810) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 18:49:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully detached device tap9de27ebd-53 from instance 197c109a-6ba4-4e9a-a177-801f3342a23d from the live domain config.
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "9de27ebd-5366-4771-869d-642cbc494383", "address": "fa:16:3e:c8:b8:7d", "network": {"id": "ae9fb839-ed6f-4bee-96f6-67f50483586a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-842055651", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de27ebd-53", "ovs_interfaceid": "9de27ebd-5366-4771-869d-642cbc494383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG os_vif [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9de27ebd-53, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "df270d5e72704ee798e3dc06a2237960249dc01c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.962s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "df270d5e72704ee798e3dc06a2237960249dc01c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "df270d5e72704ee798e3dc06a2237960249dc01c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:33 user nova-compute[72810]: INFO os_vif [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:7d,bridge_name='br-int',has_traffic_filtering=True,id=9de27ebd-5366-4771-869d-642cbc494383,network=Network(ae9fb839-ed6f-4bee-96f6-67f50483586a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de27ebd-53')
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:49:33 user nova-compute[72810]:   <nova:package version="0.0.0"/>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:name>tempest-device-tagging-server-292821082</nova:name>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:creationTime>2023-07-31 18:49:33</nova:creationTime>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:flavor name="m1.tiny">
Jul 31 18:49:33 user nova-compute[72810]:     <nova:memory>512</nova:memory>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:disk>1</nova:disk>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:swap>0</nova:swap>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:vcpus>1</nova:vcpus>
Jul 31 18:49:33 user nova-compute[72810]:   </nova:flavor>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:owner>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:user uuid="8b0dae9e132b4e198e799027ab8049ab">tempest-TaggedAttachmentsTest-1677977488-project-member</nova:user>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:project uuid="315ad01892ad4ea3bb90546e22b0c25e">tempest-TaggedAttachmentsTest-1677977488</nova:project>
Jul 31 18:49:33 user nova-compute[72810]:   </nova:owner>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:49:33 user nova-compute[72810]:   <nova:ports>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:port uuid="8b8193bd-fbe0-4488-ad06-dfa1c6228290">
Jul 31 18:49:33 user nova-compute[72810]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:49:33 user nova-compute[72810]:     </nova:port>
Jul 31 18:49:33 user nova-compute[72810]:   </nova:ports>
Jul 31 18:49:33 user nova-compute[72810]: </nova:instance>
Jul 31 18:49:33 user nova-compute[72810]:  {{(pid=72810) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c,backing_fmt=raw /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c,backing_fmt=raw /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue" returned: 0 in 0.063s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "df270d5e72704ee798e3dc06a2237960249dc01c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'migration_context' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start _get_guest_xml network_info=[{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:bc:d1:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '91b54b1c-c1b8-48f5-a1eb-4f68b097c796', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a3bc5689-d177-44f9-9cd8-d8194d711be3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b159a13f-4b04-4cf1-8664-2528b261ba7e', 'serial': 'b159a13f-4b04-4cf1-8664-2528b261ba7e'}, 'attachment_id': '17618803-1e5f-4150-8537-e5a9756f35cc', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'numa_topology' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:49:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:33 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:49:33 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:49:33 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7bf75-c011-4cab-ac49-b406a17bfd3c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YvAqJalD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 18:49:33 user nova-compute[72810]: node.name = iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e
Jul 31 18:49:33 user nova-compute[72810]: node.tpgt = -1
Jul 31 18:49:33 user nova-compute[72810]: node.startup = automatic
Jul 31 18:49:33 user nova-compute[72810]: node.leading_login = No
Jul 31 18:49:33 user nova-compute[72810]: iface.iscsi_ifacename = default
Jul 31 18:49:33 user nova-compute[72810]: iface.net_ifacename = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.ipaddress = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.prefix_len = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.hwaddress = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.transport_name = tcp
Jul 31 18:49:33 user nova-compute[72810]: iface.initiatorname = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.vlan_id = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.vlan_priority = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.vlan_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.iface_num = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.mtu = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.port = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.bootproto = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.subnet_mask = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.gateway = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_alt_client_id = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_dns = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_learn_iqn = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_vendor_id_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_vendor_id = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.dhcp_slp_da = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.fragmentation = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.gratuitous_arp = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.incoming_forwarding = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.tos_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.tos = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.ttl = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.delayed_ack = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.tcp_nagle = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.tcp_wsf_state = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.tcp_wsf = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.tcp_timer_scale = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.tcp_timestamp = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.redirect = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.def_task_mgmt_timeout = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.header_digest = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.data_digest = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.immediate_data = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.initial_r2t = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.data_seq_inorder = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.data_pdu_inorder = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.erl = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.max_receive_data_len = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.first_burst_len = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.max_outstanding_r2t = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.max_burst_len = 0
Jul 31 18:49:33 user nova-compute[72810]: iface.chap_auth = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.bidi_chap = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.strict_login_compliance = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.discovery_auth = <empty>
Jul 31 18:49:33 user nova-compute[72810]: iface.discovery_logout = <empty>
Jul 31 18:49:33 user nova-compute[72810]: node.discovery_address = <empty>
Jul 31 18:49:33 user nova-compute[72810]: node.discovery_port = 0
Jul 31 18:49:33 user nova-compute[72810]: node.discovery_type = static
Jul 31 18:49:33 user nova-compute[72810]: node.session.initial_cmdsn = 0
Jul 31 18:49:33 user nova-compute[72810]: node.session.initial_login_retry_max = 8
Jul 31 18:49:33 user nova-compute[72810]: node.session.xmit_thread_priority = -20
Jul 31 18:49:33 user nova-compute[72810]: node.session.cmds_max = 128
Jul 31 18:49:33 user nova-compute[72810]: node.session.queue_depth = 32
Jul 31 18:49:33 user nova-compute[72810]: node.session.nr_sessions = 1
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.authmethod = CHAP
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.username = YvAqJalD
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.password = ***
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.username_in = <empty>
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.password_in = <empty>
Jul 31 18:49:33 user nova-compute[72810]: node.session.auth.chap_algs = MD5
Jul 31 18:49:33 user nova-compute[72810]: node.session.timeo.replacement_timeout = 120
Jul 31 18:49:33 user nova-compute[72810]: node.session.err_timeo.abort_timeout = 15
Jul 31 18:49:33 user nova-compute[72810]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 18:49:33 user nova-compute[72810]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 18:49:33 user nova-compute[72810]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.FastAbort = Yes
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.InitialR2T = No
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.ImmediateData = Yes
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.MaxConnections = 1
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 18:49:33 user nova-compute[72810]: node.session.iscsi.ERL = 0
Jul 31 18:49:33 user nova-compute[72810]: node.session.scan = manual
Jul 31 18:49:33 user nova-compute[72810]: node.session.reopen_max = 0
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].address = 172.16.0.220
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].port = 3260
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].startup = manual
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].tcp.window_size = 524288
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].tcp.type_of_service = 0
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].timeo.logout_timeout = 15
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].timeo.login_timeout = 15
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].timeo.auth_timeout = 45
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.DataDigest = None
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.IFMarker = No
Jul 31 18:49:33 user nova-compute[72810]: node.conn[0].iscsi.OFMarker = No
Jul 31 18:49:33 user nova-compute[72810]: # END RECORD
Jul 31 18:49:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[696859f0-0901-477c-af4c-81b48891781e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f581f8-33af-4853-a881-88ab4933585f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvAqJalD {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YvAqJalD" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1999883f-058a-410e-80fb-7857f7f96e54]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YvAqJalD'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-unplugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-unplugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:33 user nova-compute[72810]: WARNING nova.compute.manager [req-ecbdf4f9-fbff-4d3c-8389-f482a51a0269 req-41424db9-d97a-4550-a09c-a33a66ec19d1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-unplugged-9de27ebd-5366-4771-869d-642cbc494383 for instance with vm_state active and task_state None.
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4463a8-00c5-4a1b-819b-1adf4d145603]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca30cf3-d5b3-48a7-a20f-546fa364ed08]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:33 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:33 user nova-compute[72810]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)
Jul 31 18:49:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:49:33 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:49:33 user nova-compute[72810]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d67d2898-70e1-43a2-95a1-5faa511fb74c (non-flash)
Jul 31 18:49:33 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] HCTL ('33', '0', '0', 0) found on session 27 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5decda96-a3ae-4008-8380-4deb53fdc118]: (4, ('0 0 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching for a device in session 27 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.216s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '23038363065363563', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038363065363563', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-401461270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-401461270',id=22,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-hblixc2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:47:59Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=a3bc5689-d177-44f9-9cd8-d8194d711be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:bc:d1:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:bc:d1:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:49:33 user nova-compute[72810]:   <uuid>a3bc5689-d177-44f9-9cd8-d8194d711be3</uuid>
Jul 31 18:49:33 user nova-compute[72810]:   <name>instance-00000016</name>
Jul 31 18:49:33 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:49:33 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:49:33 user nova-compute[72810]:   <metadata>
Jul 31 18:49:33 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:49:33 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-401461270</nova:name>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:49:33</nova:creationTime>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:49:33 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:49:33 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:owner>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:49:33 user nova-compute[72810]:       </nova:owner>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:49:33 user nova-compute[72810]:       <nova:ports>
Jul 31 18:49:33 user nova-compute[72810]:         <nova:port uuid="74c35432-d41a-419a-82ba-21c35cd4b8cb">
Jul 31 18:49:33 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:49:33 user nova-compute[72810]:         </nova:port>
Jul 31 18:49:33 user nova-compute[72810]:       </nova:ports>
Jul 31 18:49:33 user nova-compute[72810]:     </nova:instance>
Jul 31 18:49:33 user nova-compute[72810]:   </metadata>
Jul 31 18:49:33 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:49:33 user nova-compute[72810]:     <system>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="serial">a3bc5689-d177-44f9-9cd8-d8194d711be3</entry>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="uuid">a3bc5689-d177-44f9-9cd8-d8194d711be3</entry>
Jul 31 18:49:33 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:49:33 user nova-compute[72810]:     </system>
Jul 31 18:49:33 user nova-compute[72810]:   </sysinfo>
Jul 31 18:49:33 user nova-compute[72810]:   <os>
Jul 31 18:49:33 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:49:33 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:49:33 user nova-compute[72810]:   </os>
Jul 31 18:49:33 user nova-compute[72810]:   <features>
Jul 31 18:49:33 user nova-compute[72810]:     <acpi/>
Jul 31 18:49:33 user nova-compute[72810]:     <apic/>
Jul 31 18:49:33 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:49:33 user nova-compute[72810]:   </features>
Jul 31 18:49:33 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:49:33 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:49:33 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:49:33 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:49:33 user nova-compute[72810]:   </clock>
Jul 31 18:49:33 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:49:33 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:49:33 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:49:33 user nova-compute[72810]:   </cpu>
Jul 31 18:49:33 user nova-compute[72810]:   <devices>
Jul 31 18:49:33 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:49:33 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:49:33 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 18:49:33 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:49:33 user nova-compute[72810]:       <serial>b159a13f-4b04-4cf1-8664-2528b261ba7e</serial>
Jul 31 18:49:33 user nova-compute[72810]:     </disk>
Jul 31 18:49:33 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:49:33 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:49:33 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue"/>
Jul 31 18:49:33 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:49:33 user nova-compute[72810]:       <boot order="1"/>
Jul 31 18:49:33 user nova-compute[72810]:     </disk>
Jul 31 18:49:33 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:49:33 user nova-compute[72810]:       <mac address="fa:16:3e:bc:d1:c4"/>
Jul 31 18:49:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:49:33 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:49:33 user nova-compute[72810]:       <target dev="tap74c35432-d4"/>
Jul 31 18:49:33 user nova-compute[72810]:     </interface>
Jul 31 18:49:33 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:49:33 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/console.log" append="off"/>
Jul 31 18:49:33 user nova-compute[72810]:     </serial>
Jul 31 18:49:33 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:49:33 user nova-compute[72810]:     <video>
Jul 31 18:49:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:49:33 user nova-compute[72810]:     </video>
Jul 31 18:49:33 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:49:33 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:49:33 user nova-compute[72810]:     </rng>
Jul 31 18:49:33 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:49:33 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:49:33 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:49:33 user nova-compute[72810]:     </memballoon>
Jul 31 18:49:33 user nova-compute[72810]:   </devices>
Jul 31 18:49:33 user nova-compute[72810]: </domain>
Jul 31 18:49:33 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:49:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance destroyed successfully.
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:bc:d1:c4, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquired lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:49:34 user nova-compute[72810]: INFO nova.network.neutron [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Port 9de27ebd-5366-4771-869d-642cbc494383 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 31 18:49:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [{"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Releasing lock "refresh_cache-197c109a-6ba4-4e9a-a177-801f3342a23d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a09d61ed-f7cb-478e-89ac-3c331b08e2e3 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "interface-197c109a-6ba4-4e9a-a177-801f3342a23d-9de27ebd-5366-4771-869d-642cbc494383" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.036s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-ac9c433a-130c-4bfa-9e0a-a2ff8e89976b req-a6cf9709-3b60-4fde-8cb8-0ddebf57aab5 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-deleted-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:35 user nova-compute[72810]: WARNING nova.compute.manager [req-9a82a34a-102d-4f88-b52e-817d1f380b4b req-1e0ff0e1-36f9-4102-aa01-ced5c776ed6e service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-9de27ebd-5366-4771-869d-642cbc494383 for instance with vm_state active and task_state None.
Jul 31 18:49:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:36 user nova-compute[72810]: WARNING nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:49:36 user nova-compute[72810]: WARNING nova.compute.manager [req-8be7c65e-6b6a-4b55-b44f-d7f57c0c890e req-eb9ddb24-998a-43c6-aad6-882e0fe11705 service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state rescuing.
Jul 31 18:49:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for a3bc5689-d177-44f9-9cd8-d8194d711be3 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:49:37 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829377.9593055, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:49:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Resumed (Lifecycle Event)
Jul 31 18:49:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bf54e7ac-4225-40e4-b775-3b6461018fa5 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:49:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:49:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:49:38 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:49:38 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829377.9629653, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:49:38 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Started (Lifecycle Event)
Jul 31 18:49:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:49:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:49:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:38 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:49:38 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829363.8221042, dafaded3-47bf-416a-9b3e-c77fbd5e62fe => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:49:38 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] VM Stopped (Lifecycle Event)
Jul 31 18:49:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca6a84e5-eac2-42fd-a38c-ba9131f431b7 None None] [instance: dafaded3-47bf-416a-9b3e-c77fbd5e62fe] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:49:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-changed-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Refreshing instance network info cache due to event network-changed-e099c423-4f6a-4a2c-a4e5-2ca33b33676b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] Acquiring lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] Acquired lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Refreshing network info cache for port e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updated VIF entry in instance network info cache for port e099c423-4f6a-4a2c-a4e5-2ca33b33676b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updating instance_info_cache with network_info: [{"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-712f54af-0df3-4a5b-83d6-5711e1795ceb req-aa53c1f7-7e45-4fe4-a3b0-d3bb18ad60bc service nova] Releasing lock "refresh_cache-0ac70112-5aaf-493c-b810-3ad743b483e6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing instance network info cache due to event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'flavor' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:54 user nova-compute[72810]: INFO nova.compute.manager [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Attaching volume 62986dd0-2bba-4d7c-90dd-9a46967d3f6c to /dev/vdb
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.utils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe54966-ffdf-4495-86eb-c679d8702602]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updated VIF entry in instance network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[268621a0-b74d-4d8d-9a89-81f3468c17ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[39472df3-0b20-4839-90b8-2632f30fd4c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec767fa3-b46f-4315-8439-e6852eb8fa22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-74ef65ca-c3ff-4954-bce4-2a6bb7bb3214 req-47cf5928-0ed1-45ef-82f9-6bfe960865d6 service nova] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:55 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:49:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6afe3de-1e25-4e03-8a3b-e54d0b9afe75]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG os_brick.utils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:55 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating existing volume attachment record: b1a78dd6-d630-442d-8c5d-1d10ce4f6d06 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'flavor' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:49:57 user nova-compute[72810]: INFO nova.compute.manager [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Attaching volume 80a414a4-1e21-4d8e-867c-49ec50a999ce to /dev/vdb
Jul 31 18:49:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG os_brick.utils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0c907-81b4-4b6d-98d3-3f9d2df8a5bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ac0557-15c1-4dc7-8243-ca73f5958b4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f03994-0e51-4225-b460-86e7003d1f51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea93132c-a115-4191-bc09-c8d76f22628b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:49:58 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:49:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62ff24-9f36-4b3a-ab35-3eea9770ef2d]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG os_brick.utils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updating existing volume attachment record: f404afcd-34f5-4487-8e78-bca98b1b35e7 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:49:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXOiIbjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:03 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:03 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:03 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd1431-39c2-45d1-a169-d7d41a35c157]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:50:03 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046e7cc-8272-4b6a-bfda-42169bfb65da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c] added
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef0c9de-d1f6-453c-b7de-dab6d0ed7393]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93c2b2-da98-44d5-8332-c2613b85c887]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXOiIbjD {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXOiIbjD" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[344209e6-8125-44ab-bb44-0ac1ee4b17c4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXOiIbjD'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a6f64-7fe6-44cb-92c7-de021da0daf7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d254ec72-28ac-4e7b-a2ec-59803e9d9460]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e4f1e-0411-48ba-a6b8-3979b0bbad2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260]
Jul 31 18:50:03 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260] successful.
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e12995-2b3f-4b03-9acd-4cb1bce88ef3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb5e81-6077-4468-881a-44e1993c8d61]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:03 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f766b37-23aa-41f8-984a-74fe686662bf]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXOiIbjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23337343861643466', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337343861643466', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'flavor' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:50:04 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:50:04 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:50:04 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:50:04 user nova-compute[72810]:   <serial>62986dd0-2bba-4d7c-90dd-9a46967d3f6c</serial>
Jul 31 18:50:04 user nova-compute[72810]: </disk>
Jul 31 18:50:04 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:50:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:eb:f2:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-de626e57-df51-4423-8453-301cc7725429 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.314s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnlrsyTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:06 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: INFO nova.compute.manager [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Rescuing
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[789a390c-f23a-46f1-91dc-0016a19c1b8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:50:06 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54c5e99-00b4-4faa-9f52-0cca32fc8b8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce] added
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d4a20-5f72-412f-84c4-183d0f36af5e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7241f1-c2fc-4e69-9edd-ef782d485a3a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnlrsyTa {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnlrsyTa" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2069c5-2110-4f7c-90db-6d6975836fd6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnlrsyTa'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[75107c5f-4fbf-4c10-a904-1cf991a1796b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3d747a-77a1-4439-ad25-621c23db70fa]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52fe791-6abd-45cf-a082-142fddf859b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260]
Jul 31 18:50:06 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260] successful.
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8c7e51-76a3-491b-b0e6-957a1ad1aaa0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d31e21-5827-44fc-b5b0-343a9f7d621f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:06 user nova-compute[72810]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)
Jul 31 18:50:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb13cfb-d1ae-4b9b-bb37-2bf2949ee715]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:07 user nova-compute[72810]: WARNING nova.compute.manager [req-cb3f8857-c80a-4b7c-937b-09839bae799d req-00b4e877-b1eb-4dfa-8404-e4db9a1857c7 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state active and task_state rescuing.
Jul 31 18:50:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnlrsyTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26530386434613134', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530386434613134', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'flavor' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:50:07 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:50:07 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:50:07 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:50:07 user nova-compute[72810]:   <serial>80a414a4-1e21-4d8e-867c-49ec50a999ce</serial>
Jul 31 18:50:07 user nova-compute[72810]: </disk>
Jul 31 18:50:07 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:50:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance destroyed successfully.
Jul 31 18:50:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Attempting rescue
Jul 31 18:50:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:50:08 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Creating image(s)
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] No VIF found with MAC fa:16:3e:df:6e:4f, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.173s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue" returned: 0 in 0.054s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'migration_context' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start _get_guest_xml network_info=[{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:eb:f2:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'numa_topology' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972ff80-3294-4603-a9fc-1d3ed9060990 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.420s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:08 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-177221635',display_name='tempest-ServerRescueNegativeTestJSON-server-177221635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-177221635',id=24,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgtIHJMOkOY43Ou5M6fEyasQ9qqg4CbBsglARvf6ql9ZGf8quXSJhnruUMbXrBMk6+Tysmz5zDC2niFR9jiaUPrqTz0SUcY55gdmIbIWWQRtOidTnxeUVzPw7xTvsugQ==',key_name='tempest-keypair-1658891605',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-vf5ys7ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=7148a69e-e93d-407a-ba32-71442fbaae2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:eb:f2:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "vif_mac": "fa:16:3e:eb:f2:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'pci_devices' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:50:08 user nova-compute[72810]:   <uuid>7148a69e-e93d-407a-ba32-71442fbaae2e</uuid>
Jul 31 18:50:08 user nova-compute[72810]:   <name>instance-00000018</name>
Jul 31 18:50:08 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:50:08 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:50:08 user nova-compute[72810]:   <metadata>
Jul 31 18:50:08 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:50:08 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-177221635</nova:name>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:50:08</nova:creationTime>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:50:08 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:50:08 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:owner>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:user uuid="cf8b9f2a471b40b7ba541f9da121207a">tempest-ServerRescueNegativeTestJSON-1295429689-project-member</nova:user>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:project uuid="bc3897e37c484827819b5d56cee9345a">tempest-ServerRescueNegativeTestJSON-1295429689</nova:project>
Jul 31 18:50:08 user nova-compute[72810]:       </nova:owner>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:50:08 user nova-compute[72810]:       <nova:ports>
Jul 31 18:50:08 user nova-compute[72810]:         <nova:port uuid="f26fc84b-a55b-40eb-a612-379f0ad7a380">
Jul 31 18:50:08 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 18:50:08 user nova-compute[72810]:         </nova:port>
Jul 31 18:50:08 user nova-compute[72810]:       </nova:ports>
Jul 31 18:50:08 user nova-compute[72810]:     </nova:instance>
Jul 31 18:50:08 user nova-compute[72810]:   </metadata>
Jul 31 18:50:08 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:50:08 user nova-compute[72810]:     <system>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="serial">7148a69e-e93d-407a-ba32-71442fbaae2e</entry>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="uuid">7148a69e-e93d-407a-ba32-71442fbaae2e</entry>
Jul 31 18:50:08 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:50:08 user nova-compute[72810]:     </system>
Jul 31 18:50:08 user nova-compute[72810]:   </sysinfo>
Jul 31 18:50:08 user nova-compute[72810]:   <os>
Jul 31 18:50:08 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:50:08 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:50:08 user nova-compute[72810]:   </os>
Jul 31 18:50:08 user nova-compute[72810]:   <features>
Jul 31 18:50:08 user nova-compute[72810]:     <acpi/>
Jul 31 18:50:08 user nova-compute[72810]:     <apic/>
Jul 31 18:50:08 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:50:08 user nova-compute[72810]:   </features>
Jul 31 18:50:08 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:50:08 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:50:08 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:50:08 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:50:08 user nova-compute[72810]:   </clock>
Jul 31 18:50:08 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:50:08 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:50:08 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:50:08 user nova-compute[72810]:   </cpu>
Jul 31 18:50:08 user nova-compute[72810]:   <devices>
Jul 31 18:50:08 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:50:08 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:50:08 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue"/>
Jul 31 18:50:08 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:50:08 user nova-compute[72810]:     </disk>
Jul 31 18:50:08 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:50:08 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:50:08 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk"/>
Jul 31 18:50:08 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:50:08 user nova-compute[72810]:     </disk>
Jul 31 18:50:08 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:50:08 user nova-compute[72810]:       <mac address="fa:16:3e:eb:f2:29"/>
Jul 31 18:50:08 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:08 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:50:08 user nova-compute[72810]:       <target dev="tapf26fc84b-a5"/>
Jul 31 18:50:08 user nova-compute[72810]:     </interface>
Jul 31 18:50:08 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:50:08 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/console.log" append="off"/>
Jul 31 18:50:08 user nova-compute[72810]:     </serial>
Jul 31 18:50:08 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:50:08 user nova-compute[72810]:     <video>
Jul 31 18:50:08 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:08 user nova-compute[72810]:     </video>
Jul 31 18:50:08 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:50:08 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:50:08 user nova-compute[72810]:     </rng>
Jul 31 18:50:08 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:50:08 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:50:08 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:50:08 user nova-compute[72810]:     </memballoon>
Jul 31 18:50:08 user nova-compute[72810]:   </devices>
Jul 31 18:50:08 user nova-compute[72810]: </domain>
Jul 31 18:50:08 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:50:08 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance destroyed successfully.
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] No VIF found with MAC fa:16:3e:eb:f2:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:09 user nova-compute[72810]: WARNING nova.compute.manager [req-69c46447-e973-4072-98ba-e1321237be7d req-123afcdf-3e7c-42f1-9441-71b0fec79dff service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state active and task_state rescuing.
Jul 31 18:50:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:10 user nova-compute[72810]: INFO nova.compute.manager [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Detaching volume 80a414a4-1e21-4d8e-867c-49ec50a999ce
Jul 31 18:50:10 user nova-compute[72810]: INFO nova.virt.block_device [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Attempting to driver detach volume 80a414a4-1e21-4d8e-867c-49ec50a999ce from mountpoint /dev/vdb
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Attempting to detach device vdb from instance 0ac70112-5aaf-493c-b810-3ad743b483e6 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:50:11 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:50:11 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:50:11 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:50:11 user nova-compute[72810]:   <serial>80a414a4-1e21-4d8e-867c-49ec50a999ce</serial>
Jul 31 18:50:11 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:50:11 user nova-compute[72810]: </disk>
Jul 31 18:50:11 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:50:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Successfully detached device vdb from instance 0ac70112-5aaf-493c-b810-3ad743b483e6 from the persistent domain config.
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ac70112-5aaf-493c-b810-3ad743b483e6 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:50:11 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:50:11 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:50:11 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:50:11 user nova-compute[72810]:   <serial>80a414a4-1e21-4d8e-867c-49ec50a999ce</serial>
Jul 31 18:50:11 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:50:11 user nova-compute[72810]: </disk>
Jul 31 18:50:11 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:11 user nova-compute[72810]: WARNING nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state active and task_state rescuing.
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:11 user nova-compute[72810]: WARNING nova.compute.manager [req-85d8f82b-cebe-4325-bd4b-66fe4cc7d653 req-56a73ebd-ee58-4a2b-8ca8-365f52c57aa8 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state active and task_state rescuing.
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829411.4702628, 0ac70112-5aaf-493c-b810-3ad743b483e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:50:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Successfully detached device vdb from instance 0ac70112-5aaf-493c-b810-3ad743b483e6 from the live domain config.
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnlrsyTa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:11 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d71f74-e02a-4c58-abb8-2a05276c0148]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af8f8b-a25e-4de4-bf76-dfd7fc545948]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)
Jul 31 18:50:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:11 user nova-compute[72810]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce (non-flash)
Jul 31 18:50:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec0fe680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e974f-982b-4d23-b208-834cd2d038b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8b8f0-b4e4-4ae8-ac32-87a235f7c3e2]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c22180-ae42-440f-a7d8-8180bf001b47]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb7b4c-f8ea-417c-aad8-d525452fe59e]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404280c-6a92-47fe-9b39-c4e45a4fe55a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb5da8-8153-4401-b824-f6ff788ebefa]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260]
Jul 31 18:50:11 user nova-compute[72810]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce, portal: 172.16.0.220,3260] successful.
Jul 31 18:50:11 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a414a4-1e21-4d8e-867c-49ec50a999ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc32f5-e726-45d0-bf5b-056aba5c82ff]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] <== disconnect_volume: return (309ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for 7148a69e-e93d-407a-ba32-71442fbaae2e due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829412.1283731, 7148a69e-e93d-407a-ba32-71442fbaae2e => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Resumed (Lifecycle Event)
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e0b5a850-53bc-4e36-acb1-b8ed68116ce1 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829412.132894, 7148a69e-e93d-407a-ba32-71442fbaae2e => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:12 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Started (Lifecycle Event)
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:50:12 user nova-compute[72810]: INFO nova.compute.claims [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Claim successful on node user
Jul 31 18:50:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'flavor' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3cfd033c-1421-452a-95e5-a30b5e076bdc tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.994s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.802s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:50:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.policy [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b2bbbd7a792431688c8d575d2c71d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15a633ca9965410aa6ce5b2b86a6f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:50:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Creating image(s)
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "/opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "/opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "/opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.173s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk 1073741824" returned: 0 in 0.055s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:13 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.189s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Cannot resize image /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'migration_context' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Ensure instance console log exists: /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Successfully created port: f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Successfully updated port: f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquired lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-changed-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Refreshing instance network info cache due to event network-changed-f16d431d-e82b-417f-b76e-ebc877f65015. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] Acquiring lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating instance_info_cache with network_info: [{"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Releasing lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Instance network_info: |[{"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] Acquired lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Refreshing network info cache for port f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Start _get_guest_xml network_info=[{"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:50:16 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:16 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1923311124',display_name='tempest-AttachVolumeTestJSON-server-1923311124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1923311124',id=28,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOrsHDmSIX72rY01dsXeWPRHue6Xw8RY89LVagQrJuPR8YPY3TpZaf5UajW3s/K9uVUgjWuA/iDAw2w6BLAt5WFI/nyA7pWLDKjHotaVmAr2WOHuotVRNTRe+4uW+DH0w==',key_name='tempest-keypair-1315902083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-ttiza1zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=d34dc998-2354-4eb5-9271-45b42b182047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'pci_devices' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:50:16 user nova-compute[72810]:   <uuid>d34dc998-2354-4eb5-9271-45b42b182047</uuid>
Jul 31 18:50:16 user nova-compute[72810]:   <name>instance-0000001c</name>
Jul 31 18:50:16 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:50:16 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:50:16 user nova-compute[72810]:   <metadata>
Jul 31 18:50:16 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:50:16 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeTestJSON-server-1923311124</nova:name>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:50:16</nova:creationTime>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:50:16 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:50:16 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:owner>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:user uuid="3b2bbbd7a792431688c8d575d2c71d21">tempest-AttachVolumeTestJSON-1714901238-project-member</nova:user>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:project uuid="15a633ca9965410aa6ce5b2b86a6f198">tempest-AttachVolumeTestJSON-1714901238</nova:project>
Jul 31 18:50:16 user nova-compute[72810]:       </nova:owner>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:50:16 user nova-compute[72810]:       <nova:ports>
Jul 31 18:50:16 user nova-compute[72810]:         <nova:port uuid="f16d431d-e82b-417f-b76e-ebc877f65015">
Jul 31 18:50:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 18:50:16 user nova-compute[72810]:         </nova:port>
Jul 31 18:50:16 user nova-compute[72810]:       </nova:ports>
Jul 31 18:50:16 user nova-compute[72810]:     </nova:instance>
Jul 31 18:50:16 user nova-compute[72810]:   </metadata>
Jul 31 18:50:16 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:50:16 user nova-compute[72810]:     <system>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="serial">d34dc998-2354-4eb5-9271-45b42b182047</entry>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="uuid">d34dc998-2354-4eb5-9271-45b42b182047</entry>
Jul 31 18:50:16 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:50:16 user nova-compute[72810]:     </system>
Jul 31 18:50:16 user nova-compute[72810]:   </sysinfo>
Jul 31 18:50:16 user nova-compute[72810]:   <os>
Jul 31 18:50:16 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:50:16 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:50:16 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:50:16 user nova-compute[72810]:   </os>
Jul 31 18:50:16 user nova-compute[72810]:   <features>
Jul 31 18:50:16 user nova-compute[72810]:     <acpi/>
Jul 31 18:50:16 user nova-compute[72810]:     <apic/>
Jul 31 18:50:16 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:50:16 user nova-compute[72810]:   </features>
Jul 31 18:50:16 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:50:16 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:50:16 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:50:16 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:50:16 user nova-compute[72810]:   </clock>
Jul 31 18:50:16 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:50:16 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:50:16 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:50:16 user nova-compute[72810]:   </cpu>
Jul 31 18:50:16 user nova-compute[72810]:   <devices>
Jul 31 18:50:16 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:50:16 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:50:16 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk"/>
Jul 31 18:50:16 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:50:16 user nova-compute[72810]:     </disk>
Jul 31 18:50:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:50:16 user nova-compute[72810]:       <mac address="fa:16:3e:c3:27:e1"/>
Jul 31 18:50:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:50:16 user nova-compute[72810]:       <target dev="tapf16d431d-e8"/>
Jul 31 18:50:16 user nova-compute[72810]:     </interface>
Jul 31 18:50:16 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:50:16 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/console.log" append="off"/>
Jul 31 18:50:16 user nova-compute[72810]:     </serial>
Jul 31 18:50:16 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:50:16 user nova-compute[72810]:     <video>
Jul 31 18:50:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:16 user nova-compute[72810]:     </video>
Jul 31 18:50:16 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:50:16 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:50:16 user nova-compute[72810]:     </rng>
Jul 31 18:50:16 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:50:16 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:50:16 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:50:16 user nova-compute[72810]:     </memballoon>
Jul 31 18:50:16 user nova-compute[72810]:   </devices>
Jul 31 18:50:16 user nova-compute[72810]: </domain>
Jul 31 18:50:16 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1923311124',display_name='tempest-AttachVolumeTestJSON-server-1923311124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1923311124',id=28,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOrsHDmSIX72rY01dsXeWPRHue6Xw8RY89LVagQrJuPR8YPY3TpZaf5UajW3s/K9uVUgjWuA/iDAw2w6BLAt5WFI/nyA7pWLDKjHotaVmAr2WOHuotVRNTRe+4uW+DH0w==',key_name='tempest-keypair-1315902083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-ttiza1zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=d34dc998-2354-4eb5-9271-45b42b182047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG os_vif [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf16d431d-e8, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf16d431d-e8, col_values=(('external_ids', {'iface-id': 'f16d431d-e82b-417f-b76e-ebc877f65015', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:27:e1', 'vm-uuid': 'd34dc998-2354-4eb5-9271-45b42b182047'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:16 user nova-compute[72810]: INFO os_vif [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8')
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No VIF found with MAC fa:16:3e:c3:27:e1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updated VIF entry in instance network info cache for port f16d431d-e82b-417f-b76e-ebc877f65015. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating instance_info_cache with network_info: [{"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cef4ca6f-8a62-4aa2-aa5a-2b6eb8739b28 req-86856b41-a5b3-4f64-88c1-6b688bb4726e service nova] Releasing lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:50:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829420.085277, d34dc998-2354-4eb5-9271-45b42b182047 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] VM Resumed (Lifecycle Event)
Jul 31 18:50:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] No waiting events found dispatching network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:20 user nova-compute[72810]: WARNING nova.compute.manager [req-127f26a3-0f3e-499f-a493-33d51e63ff04 req-68d9ce06-28eb-4bd8-bf4b-062be6ed029d service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received unexpected event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 for instance with vm_state building and task_state spawning.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-changed-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing instance network info cache due to event network-changed-54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] Acquiring lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] Acquired lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.network.neutron [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Refreshing network info cache for port 54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] No waiting events found dispatching network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:20 user nova-compute[72810]: WARNING nova.compute.manager [req-d3a467ab-f684-4b76-a71c-68d24e5bcd02 req-17a1c833-9cd9-45d0-9828-af9df7ad13f1 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received unexpected event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 for instance with vm_state building and task_state spawning.
Jul 31 18:50:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7074MB free_disk=25.354488372802734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Instance spawned successfully.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829420.0860558, d34dc998-2354-4eb5-9271-45b42b182047 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] VM Started (Lifecycle Event)
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Took 7.09 seconds to spawn the instance on the hypervisor.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 197c109a-6ba4-4e9a-a177-801f3342a23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0ac70112-5aaf-493c-b810-3ad743b483e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d34dc998-2354-4eb5-9271-45b42b182047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 91b26445-f839-418c-ba6d-776b470b5461 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:50:20 user nova-compute[72810]: INFO nova.compute.manager [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Took 8.33 seconds to build instance.
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bfd2a274-7681-42e8-81c8-9c9be8cfa8d0 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.436s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updated VIF entry in instance network info cache for port 54438c8e-25a3-411a-b897-df13142f4016. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [{"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f843b5f7-ae94-476d-8c1d-4c1daab80921 req-50d54ac1-7169-4002-81df-b715683be7ff service nova] Releasing lock "refresh_cache-1e9cae76-2122-436a-868b-bb8c500abfe1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.963s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.607s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:50:21 user nova-compute[72810]: INFO nova.compute.claims [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Claim successful on node user
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-changed-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Refreshing instance network info cache due to event network-changed-2d7abd07-ce56-49ef-860e-be4aab4c2841. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:21 user nova-compute[72810]: DEBUG nova.network.neutron [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Refreshing network info cache for port 2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Stashing vm_state: active {{(pid=72810) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:50:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:50:22 user nova-compute[72810]: INFO nova.compute.claims [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Claim successful on node user
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'resources' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:50:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Creating image(s)
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "/opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "/opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.network.neutron [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updated VIF entry in instance network info cache for port 2d7abd07-ce56-49ef-860e-be4aab4c2841. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.network.neutron [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.policy [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84386ba984b649c69a4a1110fe7954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4ba7112dc8b41f8aad49ea1ce030afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:50:22 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating resource usage from migration 21105692-beac-40bf-8317-90fba4dfdfc9
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b5adabd-af99-4fd3-b8ba-4c54680e65c9 req-323b191c-68ee-4b26-a35d-b9b38550ec2d service nova] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.180s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk 1073741824" returned: 0 in 0.059s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:50:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Cannot resize image /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.objects.instance [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'migration_context' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Ensure instance console log exists: /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.056s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:23 user nova-compute[72810]: INFO nova.compute.manager [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Migrating
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Successfully created port: 2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:23 user nova-compute[72810]: INFO nova.compute.manager [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Terminating instance
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-unplugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-unplugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-534fa075-b4ca-4788-98b8-2b649d17b114 req-caff5848-2325-42c5-9a5d-5a58abde9826 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-unplugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Starting migrate_disk_and_power_off {{(pid=72810) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 18:50:24 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Instance destroyed successfully.
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.objects.instance [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lazy-loading 'resources' on Instance uuid 197c109a-6ba4-4e9a-a177-801f3342a23d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T18:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-292821082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-292821082',id=21,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxJfkDdfx0EFPHI722M9yjppIHZVY8nP2cQqxp+8EVra55gzvtSXmmlUmpCOx7gk/kLuEv5LeJcB5j0LHCzzHlRhNuC+kRE+r+HapCyZptBXpB5dzGN/ejLD/SVebLVIw==',key_name='tempest-keypair-886747963',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='315ad01892ad4ea3bb90546e22b0c25e',ramdisk_id='',reservation_id='r-66yl6myb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1677977488',owner_user_name='tempest-TaggedAttachmentsTest-1677977488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b0dae9e132b4e198e799027ab8049ab',uuid=197c109a-6ba4-4e9a-a177-801f3342a23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converting VIF {"id": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "address": "fa:16:3e:e6:ac:ce", "network": {"id": "b402d929-cef4-4b80-b948-8bd4dfcb98cf", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-140071685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "315ad01892ad4ea3bb90546e22b0c25e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8193bd-fb", "ovs_interfaceid": "8b8193bd-fbe0-4488-ad06-dfa1c6228290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG os_vif [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8193bd-fb, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:24 user nova-compute[72810]: INFO os_vif [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:ac:ce,bridge_name='br-int',has_traffic_filtering=True,id=8b8193bd-fbe0-4488-ad06-dfa1c6228290,network=Network(b402d929-cef4-4b80-b948-8bd4dfcb98cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8193bd-fb')
Jul 31 18:50:24 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Deleting instance files /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d_del
Jul 31 18:50:24 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Deletion of /opt/stack/data/nova/instances/197c109a-6ba4-4e9a-a177-801f3342a23d_del complete
Jul 31 18:50:24 user nova-compute[72810]: INFO nova.compute.manager [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 18:50:24 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [{"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-d138fb7b-7969-4099-8e54-dfd892738660" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:50:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance destroyed successfully.
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d7abd07-ce, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:25 user nova-compute[72810]: INFO os_vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce')
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfed632-9bba-4c72-be0f-bed7b0696469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d66231-0b76-4bca-acbb-7c2332900d06]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:25 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:25 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:25 user nova-compute[72810]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:25 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec3129e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f18d32-4b01-4e56-b7e1-0620a7d17a38]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe34be-e415-47e0-8134-addfb780b35e]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0fcb7e-2b6f-4e09-adaf-dfb48e32fe98]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb16d0-488c-4b3a-a5f3-dc38efaf92f2]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb17e1-6f4f-43c0-ad70-5ce44543fa86]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051978d-f7b9-4db4-b6ec-06eaffa5762f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]
Jul 31 18:50:25 user nova-compute[72810]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.
Jul 31 18:50:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a56fc6-bf40-4958-b62b-552a11ee86fc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== disconnect_volume: return (359ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:25 user nova-compute[72810]: WARNING nova.compute.manager [req-9821b3f6-8a4d-49d1-b47d-5bd257558759 req-a4b28bf4-c76a-4395-954f-f8649020a5e9 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state active and task_state resize_migrating.
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] Acquiring lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] No waiting events found dispatching network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:25 user nova-compute[72810]: WARNING nova.compute.manager [req-7f35c881-5e90-4b65-ac34-2250d6d6dcb2 req-b486439e-c5be-4b06-990d-7b7ea6beeba1 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received unexpected event network-vif-plugged-8b8193bd-fbe0-4488-ad06-dfa1c6228290 for instance with vm_state active and task_state deleting.
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:26 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Took 1.51 seconds to deallocate network for instance.
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-87e60c85-8550-4bd8-a37b-c7b10ac3c950 req-3a50d7cc-18fb-4354-9862-2bc999c6c8f4 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Received event network-vif-deleted-8b8193bd-fbe0-4488-ad06-dfa1c6228290 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:26 user nova-compute[72810]: INFO nova.compute.manager [req-87e60c85-8550-4bd8-a37b-c7b10ac3c950 req-3a50d7cc-18fb-4354-9862-2bc999c6c8f4 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Neutron deleted interface 8b8193bd-fbe0-4488-ad06-dfa1c6228290; detaching it from the instance and deleting it from the info cache
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [req-87e60c85-8550-4bd8-a37b-c7b10ac3c950 req-3a50d7cc-18fb-4354-9862-2bc999c6c8f4 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-87e60c85-8550-4bd8-a37b-c7b10ac3c950 req-3a50d7cc-18fb-4354-9862-2bc999c6c8f4 service nova] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Detach interface failed, port_id=8b8193bd-fbe0-4488-ad06-dfa1c6228290, reason: Instance 197c109a-6ba4-4e9a-a177-801f3342a23d could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Successfully updated port: 2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquired lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:26 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Deleted allocations for instance 197c109a-6ba4-4e9a-a177-801f3342a23d
Jul 31 18:50:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Port 2d7abd07-ce56-49ef-860e-be4aab4c2841 binding to destination host user is already ACTIVE {{(pid=72810) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87cfd6a8-b615-4543-b190-a703c57c1518 tempest-TaggedAttachmentsTest-1677977488 tempest-TaggedAttachmentsTest-1677977488-project-member] Lock "197c109a-6ba4-4e9a-a177-801f3342a23d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.341s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating instance_info_cache with network_info: [{"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Releasing lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Instance network_info: |[{"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Start _get_guest_xml network_info=[{"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:50:27 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:27 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014895116',display_name='tempest-AttachVolumeNegativeTest-server-1014895116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014895116',id=29,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzjaOXDFqpoHTYZQbuDk84IkMqE32NVkn9Y5RC20D1OPgOEtLPGqMunM48rUYQxhxd3yuR21+deQUG3WuPSa8Bj1tFTSodX7Dd1UbFlg9TO7Av5S5o4JR44h51ZcJTahA==',key_name='tempest-keypair-867897121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-bw6y0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=91b26445-f839-418c-ba6d-776b470b5461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.objects.instance [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'pci_devices' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:50:27 user nova-compute[72810]:   <uuid>91b26445-f839-418c-ba6d-776b470b5461</uuid>
Jul 31 18:50:27 user nova-compute[72810]:   <name>instance-0000001d</name>
Jul 31 18:50:27 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:50:27 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:50:27 user nova-compute[72810]:   <metadata>
Jul 31 18:50:27 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:50:27 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1014895116</nova:name>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:50:27</nova:creationTime>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:50:27 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:50:27 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:owner>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:user uuid="84386ba984b649c69a4a1110fe7954dc">tempest-AttachVolumeNegativeTest-1544720465-project-member</nova:user>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:project uuid="d4ba7112dc8b41f8aad49ea1ce030afb">tempest-AttachVolumeNegativeTest-1544720465</nova:project>
Jul 31 18:50:27 user nova-compute[72810]:       </nova:owner>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:50:27 user nova-compute[72810]:       <nova:ports>
Jul 31 18:50:27 user nova-compute[72810]:         <nova:port uuid="2d35946e-5e64-4046-ba9e-4dfbe9d53b70">
Jul 31 18:50:27 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 18:50:27 user nova-compute[72810]:         </nova:port>
Jul 31 18:50:27 user nova-compute[72810]:       </nova:ports>
Jul 31 18:50:27 user nova-compute[72810]:     </nova:instance>
Jul 31 18:50:27 user nova-compute[72810]:   </metadata>
Jul 31 18:50:27 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:50:27 user nova-compute[72810]:     <system>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="serial">91b26445-f839-418c-ba6d-776b470b5461</entry>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="uuid">91b26445-f839-418c-ba6d-776b470b5461</entry>
Jul 31 18:50:27 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:50:27 user nova-compute[72810]:     </system>
Jul 31 18:50:27 user nova-compute[72810]:   </sysinfo>
Jul 31 18:50:27 user nova-compute[72810]:   <os>
Jul 31 18:50:27 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:50:27 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:50:27 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:50:27 user nova-compute[72810]:   </os>
Jul 31 18:50:27 user nova-compute[72810]:   <features>
Jul 31 18:50:27 user nova-compute[72810]:     <acpi/>
Jul 31 18:50:27 user nova-compute[72810]:     <apic/>
Jul 31 18:50:27 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:50:27 user nova-compute[72810]:   </features>
Jul 31 18:50:27 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:50:27 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:50:27 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:50:27 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:50:27 user nova-compute[72810]:   </clock>
Jul 31 18:50:27 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:50:27 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:50:27 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:50:27 user nova-compute[72810]:   </cpu>
Jul 31 18:50:27 user nova-compute[72810]:   <devices>
Jul 31 18:50:27 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:50:27 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:50:27 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk"/>
Jul 31 18:50:27 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:50:27 user nova-compute[72810]:     </disk>
Jul 31 18:50:27 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:50:27 user nova-compute[72810]:       <mac address="fa:16:3e:53:b9:3c"/>
Jul 31 18:50:27 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:27 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:50:27 user nova-compute[72810]:       <target dev="tap2d35946e-5e"/>
Jul 31 18:50:27 user nova-compute[72810]:     </interface>
Jul 31 18:50:27 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:50:27 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/console.log" append="off"/>
Jul 31 18:50:27 user nova-compute[72810]:     </serial>
Jul 31 18:50:27 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:50:27 user nova-compute[72810]:     <video>
Jul 31 18:50:27 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:27 user nova-compute[72810]:     </video>
Jul 31 18:50:27 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:50:27 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:50:27 user nova-compute[72810]:     </rng>
Jul 31 18:50:27 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:50:27 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:50:27 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:50:27 user nova-compute[72810]:     </memballoon>
Jul 31 18:50:27 user nova-compute[72810]:   </devices>
Jul 31 18:50:27 user nova-compute[72810]: </domain>
Jul 31 18:50:27 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014895116',display_name='tempest-AttachVolumeNegativeTest-server-1014895116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014895116',id=29,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzjaOXDFqpoHTYZQbuDk84IkMqE32NVkn9Y5RC20D1OPgOEtLPGqMunM48rUYQxhxd3yuR21+deQUG3WuPSa8Bj1tFTSodX7Dd1UbFlg9TO7Av5S5o4JR44h51ZcJTahA==',key_name='tempest-keypair-867897121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-bw6y0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=91b26445-f839-418c-ba6d-776b470b5461,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_vif [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d35946e-5e, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d35946e-5e, col_values=(('external_ids', {'iface-id': '2d35946e-5e64-4046-ba9e-4dfbe9d53b70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b9:3c', 'vm-uuid': '91b26445-f839-418c-ba6d-776b470b5461'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:27 user nova-compute[72810]: INFO os_vif [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e')
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:53:b9:3c, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:27 user nova-compute[72810]: WARNING nova.compute.manager [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state active and task_state resize_migrated.
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-changed-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Refreshing instance network info cache due to event network-changed-2d35946e-5e64-4046-ba9e-4dfbe9d53b70. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Acquiring lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Acquired lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Refreshing network info cache for port 2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.utils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b256804f-eb91-4f40-bdf2-d1bfabcb71a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[881357d0-c70b-4077-b5c6-b573486ee766]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b27785-7be5-49dd-bcf6-7ba7f65c9b62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ae1a35-34bb-4d06-b9ed-570e5410ad1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:50:27 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:50:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e147fe7-2905-4e63-ad55-cdb874b1c1aa]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:50:27 user nova-compute[72810]: DEBUG os_brick.utils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updated VIF entry in instance network info cache for port 2d35946e-5e64-4046-ba9e-4dfbe9d53b70. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating instance_info_cache with network_info: [{"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2ec85ef6-fd77-4824-8466-f4ffc5d1d6a1 req-69611887-d67d-4990-8b74-22c69d100601 service nova] Releasing lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:29 user nova-compute[72810]: WARNING nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state building and task_state spawning.
Jul 31 18:50:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:29 user nova-compute[72810]: WARNING nova.compute.manager [req-c58927d1-7cc6-4c78-925a-6f6169bbb2ad req-a6281bc4-d84c-417f-816d-34d86ea4b69c service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state building and task_state spawning.
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829430.862819, 91b26445-f839-418c-ba6d-776b470b5461 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] VM Resumed (Lifecycle Event)
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:50:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Instance spawned successfully.
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829430.8663583, 91b26445-f839-418c-ba6d-776b470b5461 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:30 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] VM Started (Lifecycle Event)
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:30 user nova-compute[72810]: INFO nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Took 8.62 seconds to spawn the instance on the hypervisor.
Jul 31 18:50:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:31 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:50:31 user nova-compute[72810]: INFO nova.compute.manager [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Took 10.42 seconds to build instance.
Jul 31 18:50:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c9f0ad23-44f5-48ba-b20c-8fec54034915 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.782s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing instance network info cache due to event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:50:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:50:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:50:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Starting finish_migration {{(pid=72810) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:50:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Creating image(s)
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Ensure instance console log exists: /opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start _get_guest_xml network_info=[{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8d000a70-0038-4b61-a514-694a492372a7', 'attached_at': '2023-07-31T18:50:36.000000', 'detached_at': '', 'volume_id': '048e03ab-5ec8-440a-8ba0-cff75772ef83', 'serial': '048e03ab-5ec8-440a-8ba0-cff75772ef83'}, 'attachment_id': '7b595c77-40c9-4328-a65b-c9ae02569d9f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:50:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:50:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:50:36 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[46349f83-357f-4f74-86ca-83df7d6e6afe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updated VIF entry in instance network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.network.neutron [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:50:36 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-24d490bc-653e-4915-9464-b9cd360ce5e1 req-d8eeb732-fd52-4fb3-95fc-e80e559e1373 service nova] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[631539ac-4f35-42d2-9743-45f1bd8a0166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83] added
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fd7771-eac3-43df-a82b-a24f9ca8f3ef]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb0c0a-7894-4274-85fc-72ccd9e7085a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjntpELw {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjntpELw" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debb8d2-1788-4a14-b9a7-5e39e06e6ba0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjntpELw'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc734a1-86d3-419f-b4d7-2b008b01a26e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0758f22-5d54-494b-98b4-f5ce1f1af3b6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e988a3a3-b214-4650-873e-c4c67c8593f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]
Jul 31 18:50:36 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b149a92-228e-488c-89a4-6865bacee2b4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b540d-eebe-4d35-b2d8-56a97467bef2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:50:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:50:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0243ec-c34c-412c-a3e7-58e7d60afaaf]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:50:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:36 user nova-compute[72810]: INFO nova.compute.manager [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] instance snapshotting
Jul 31 18:50:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Beginning live snapshot process
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23962363934663231', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363934663231', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:50:37 user nova-compute[72810]:   <uuid>8d000a70-0038-4b61-a514-694a492372a7</uuid>
Jul 31 18:50:37 user nova-compute[72810]:   <name>instance-00000019</name>
Jul 31 18:50:37 user nova-compute[72810]:   <memory>2097152</memory>
Jul 31 18:50:37 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:50:37 user nova-compute[72810]:   <metadata>
Jul 31 18:50:37 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:50:37 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:50:37 user nova-compute[72810]:       <nova:name>tempest-ServerActionsTestOtherA-server-658508307</nova:name>
Jul 31 18:50:37 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:50:36</nova:creationTime>
Jul 31 18:50:37 user nova-compute[72810]:       <nova:flavor name="m1.small">
Jul 31 18:50:37 user nova-compute[72810]:         <nova:memory>2048</nova:memory>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:disk>20</nova:disk>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:50:37 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:50:37 user nova-compute[72810]:       <nova:owner>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:user uuid="a818426c4f424127a01cb9f57e076603">tempest-ServerActionsTestOtherA-1074391512-project-member</nova:user>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:project uuid="38248d933d4d42a9aca885b10fbd1afa">tempest-ServerActionsTestOtherA-1074391512</nova:project>
Jul 31 18:50:37 user nova-compute[72810]:       </nova:owner>
Jul 31 18:50:37 user nova-compute[72810]:       <nova:ports>
Jul 31 18:50:37 user nova-compute[72810]:         <nova:port uuid="2d7abd07-ce56-49ef-860e-be4aab4c2841">
Jul 31 18:50:37 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 18:50:37 user nova-compute[72810]:         </nova:port>
Jul 31 18:50:37 user nova-compute[72810]:       </nova:ports>
Jul 31 18:50:37 user nova-compute[72810]:     </nova:instance>
Jul 31 18:50:37 user nova-compute[72810]:   </metadata>
Jul 31 18:50:37 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:50:37 user nova-compute[72810]:     <system>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="serial">8d000a70-0038-4b61-a514-694a492372a7</entry>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="uuid">8d000a70-0038-4b61-a514-694a492372a7</entry>
Jul 31 18:50:37 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:50:37 user nova-compute[72810]:     </system>
Jul 31 18:50:37 user nova-compute[72810]:   </sysinfo>
Jul 31 18:50:37 user nova-compute[72810]:   <os>
Jul 31 18:50:37 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:50:37 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:50:37 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:50:37 user nova-compute[72810]:   </os>
Jul 31 18:50:37 user nova-compute[72810]:   <features>
Jul 31 18:50:37 user nova-compute[72810]:     <acpi/>
Jul 31 18:50:37 user nova-compute[72810]:     <apic/>
Jul 31 18:50:37 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:50:37 user nova-compute[72810]:   </features>
Jul 31 18:50:37 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:50:37 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:50:37 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:50:37 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:50:37 user nova-compute[72810]:   </clock>
Jul 31 18:50:37 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:50:37 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:50:37 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:50:37 user nova-compute[72810]:   </cpu>
Jul 31 18:50:37 user nova-compute[72810]:   <devices>
Jul 31 18:50:37 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:50:37 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:50:37 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:50:37 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:50:37 user nova-compute[72810]:       <serial>048e03ab-5ec8-440a-8ba0-cff75772ef83</serial>
Jul 31 18:50:37 user nova-compute[72810]:     </disk>
Jul 31 18:50:37 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:50:37 user nova-compute[72810]:       <mac address="fa:16:3e:09:27:db"/>
Jul 31 18:50:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:37 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:50:37 user nova-compute[72810]:       <target dev="tap2d7abd07-ce"/>
Jul 31 18:50:37 user nova-compute[72810]:     </interface>
Jul 31 18:50:37 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:50:37 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7/console.log" append="off"/>
Jul 31 18:50:37 user nova-compute[72810]:     </serial>
Jul 31 18:50:37 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:50:37 user nova-compute[72810]:     <video>
Jul 31 18:50:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:50:37 user nova-compute[72810]:     </video>
Jul 31 18:50:37 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:50:37 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:50:37 user nova-compute[72810]:     </rng>
Jul 31 18:50:37 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:50:37 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:50:37 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:50:37 user nova-compute[72810]:     </memballoon>
Jul 31 18:50:37 user nova-compute[72810]:   </devices>
Jul 31 18:50:37 user nova-compute[72810]: </domain>
Jul 31 18:50:37 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-538678063-network", "vif_mac": "fa:16:3e:09:27:db"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG os_vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d7abd07-ce, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d7abd07-ce, col_values=(('external_ids', {'iface-id': '2d7abd07-ce56-49ef-860e-be4aab4c2841', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:27:db', 'vm-uuid': '8d000a70-0038-4b61-a514-694a492372a7'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:37 user nova-compute[72810]: INFO os_vif [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce')
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6.delta 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6.delta 1073741824" returned: 0 in 0.057s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] No VIF found with MAC fa:16:3e:09:27:db, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:37 user nova-compute[72810]: INFO nova.compute.manager [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Terminating instance
Jul 31 18:50:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG nova.compute.manager [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-unplugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG nova.compute.manager [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] No waiting events found dispatching network-vif-unplugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG nova.compute.manager [req-405ed16e-ba99-487e-98bc-eccfa51cb6ff req-0a2b4f7b-10ee-442a-9580-3f5890b51cb1 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-unplugged-27150ea6-cf83-4e15-b6af-915a1583fecc for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:50:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829424.3668885, 197c109a-6ba4-4e9a-a177-801f3342a23d => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:39 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] VM Stopped (Lifecycle Event)
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-47636b21-305b-46cf-859f-9fab9b38d253 None None] [instance: 197c109a-6ba4-4e9a-a177-801f3342a23d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:50:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6.delta /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:50:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Instance destroyed successfully.
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lazy-loading 'resources' on Instance uuid 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-489895522',display_name='tempest-VolumesNegativeTest-instance-489895522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-489895522',id=27,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f1c84500e27412d96ee1665bfd41a5b',ramdisk_id='',reservation_id='r-3i039ppw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1032305804',owner_user_name='tempest-VolumesNegativeTest-1032305804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:48:55Z,user_data=None,user_id='b7e717c7bc3f444bacddaaa30a1c46fc',uuid=4301cfd5-6e4d-4f09-a712-1d2a6c1722e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converting VIF {"id": "27150ea6-cf83-4e15-b6af-915a1583fecc", "address": "fa:16:3e:ac:86:a6", "network": {"id": "a307cf81-53ae-4bb0-a7f2-f3de99c868b6", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "eb6fcf40cb514b7ab65dc47bd4ae0fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27150ea6-cf", "ovs_interfaceid": "27150ea6-cf83-4e15-b6af-915a1583fecc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG os_vif [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27150ea6-cf, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: INFO os_vif [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=27150ea6-cf83-4e15-b6af-915a1583fecc,network=Network(a307cf81-53ae-4bb0-a7f2-f3de99c868b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27150ea6-cf')
Jul 31 18:50:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Deleting instance files /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6_del
Jul 31 18:50:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Deletion of /opt/stack/data/nova/instances/4301cfd5-6e4d-4f09-a712-1d2a6c1722e6_del complete
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6.delta /opt/stack/data/nova/instances/snapshots/tmp4zf7z276/5833f4499d444aaba21c14ba178869a6" returned: 0 in 0.396s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:50:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Snapshot extracted, beginning image upload
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829425.1067245, 8d000a70-0038-4b61-a514-694a492372a7 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:40 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Stopped (Lifecycle Event)
Jul 31 18:50:40 user nova-compute[72810]: INFO nova.compute.manager [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Took 2.13 seconds to destroy the instance on the hypervisor.
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9e7fc1a5-5a78-4af4-b3dd-eafd31434432 None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] Acquiring lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] No waiting events found dispatching network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:40 user nova-compute[72810]: WARNING nova.compute.manager [req-c0a97c4d-5cd3-4785-9ab7-d6bcadaf71f2 req-29f0fa13-879d-42e8-8ec1-9cd378d5d5ff service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received unexpected event network-vif-plugged-27150ea6-cf83-4e15-b6af-915a1583fecc for instance with vm_state active and task_state deleting.
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:40 user nova-compute[72810]: WARNING nova.compute.manager [req-17a115ad-736d-4982-9ef4-9834c6976b8b req-c8f8ddbf-d161-421f-b43f-b58c3ca5f255 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state active and task_state resize_finish.
Jul 31 18:50:41 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:50:41 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Took 1.67 seconds to deallocate network for instance.
Jul 31 18:50:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-c4a87082-2de0-427e-be70-5e01a15dd2ee req-8b5eca65-7904-4f71-b91a-b77901d4fa57 service nova] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Received event network-vif-deleted-27150ea6-cf83-4e15-b6af-915a1583fecc {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Deleted allocations for instance 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6
Jul 31 18:50:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a87778e-9dc8-4285-9a98-ebfffb66750e tempest-VolumesNegativeTest-1032305804 tempest-VolumesNegativeTest-1032305804-project-member] Lock "4301cfd5-6e4d-4f09-a712-1d2a6c1722e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.636s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829442.63485, 8d000a70-0038-4b61-a514-694a492372a7 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Resumed (Lifecycle Event)
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance running successfully.
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Failed to set time: agent not configured {{(pid=72810) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d421266c-e3a6-4377-ba8a-c5213e2a86cf tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] finish_migration finished successfully. {{(pid=72810) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829442.6583397, 8d000a70-0038-4b61-a514-694a492372a7 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Started (Lifecycle Event)
Jul 31 18:50:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:50:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:50:42 user nova-compute[72810]: WARNING nova.compute.manager [req-c7a4c933-27b8-4739-92e0-15043bcff0a1 req-564c8e40-5a32-445d-8960-386f18d8bbab service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state active and task_state resize_finish.
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Snapshot image upload complete
Jul 31 18:50:42 user nova-compute[72810]: INFO nova.compute.manager [None req-89a7dffe-8613-4bc9-bf6c-b89d9ea900f9 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Took 5.93 seconds to snapshot the instance on the hypervisor.
Jul 31 18:50:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:54 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829439.926089, 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:50:54 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] VM Stopped (Lifecycle Event)
Jul 31 18:50:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-84ceb54e-9555-4ae3-8818-15450ce8fc89 None None] [instance: 4301cfd5-6e4d-4f09-a712-1d2a6c1722e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:50:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:50:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:05 user nova-compute[72810]: INFO nova.compute.manager [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Terminating instance
Jul 31 18:51:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-unplugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] No waiting events found dispatching network-vif-unplugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-e3f364e0-0012-40bd-9bd1-449ec384c85f req-8ee662d3-b796-45c8-af34-c0dabfe12245 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-unplugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:51:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Instance destroyed successfully.
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lazy-loading 'resources' on Instance uuid 0ac70112-5aaf-493c-b810-3ad743b483e6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-769194510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7691945',id=23,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwVg/+r9aYw0N+BLKYeacXjy5SVx4fQmoqtLln8ru3keqK6lBQPR5Y3I5ICFRIFOCzkOACQiwD2lRz8iguer3b+5WWkjTjYt5/EmQZDEq6gMhyVM4wBJ73OPScf2yOyug==',key_name='tempest-keypair-829386307',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8d44d8eaa8e49869ff52813946162f7',ramdisk_id='',reservation_id='r-7ckpdwuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:48:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb5f82edcbc8455d8ddf98bcaa9e4e58',uuid=0ac70112-5aaf-493c-b810-3ad743b483e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converting VIF {"id": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "address": "fa:16:3e:df:6e:4f", "network": {"id": "f20216e1-7982-4614-96f0-6ed5dd9d02b0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1490668451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8d44d8eaa8e49869ff52813946162f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape099c423-4f", "ovs_interfaceid": "e099c423-4f6a-4a2c-a4e5-2ca33b33676b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG os_vif [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape099c423-4f, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:51:06 user nova-compute[72810]: INFO os_vif [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=e099c423-4f6a-4a2c-a4e5-2ca33b33676b,network=Network(f20216e1-7982-4614-96f0-6ed5dd9d02b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape099c423-4f')
Jul 31 18:51:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Deleting instance files /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6_del
Jul 31 18:51:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Deletion of /opt/stack/data/nova/instances/0ac70112-5aaf-493c-b810-3ad743b483e6_del complete
Jul 31 18:51:06 user nova-compute[72810]: INFO nova.compute.manager [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 31 18:51:06 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:51:06 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:07 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Took 0.98 seconds to deallocate network for instance.
Jul 31 18:51:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 18:51:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] Acquiring lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] No waiting events found dispatching network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:08 user nova-compute[72810]: WARNING nova.compute.manager [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received unexpected event network-vif-plugged-e099c423-4f6a-4a2c-a4e5-2ca33b33676b for instance with vm_state deleted and task_state None.
Jul 31 18:51:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-5944f517-f320-4b01-9437-fc4fba07b71c req-91645643-a7f7-46cd-b596-de2d847a55b3 service nova] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Received event network-vif-deleted-e099c423-4f6a-4a2c-a4e5-2ca33b33676b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.605s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:08 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Deleted allocations for instance 0ac70112-5aaf-493c-b810-3ad743b483e6
Jul 31 18:51:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9cf57352-4881-4bd3-bd68-8b886ab562e2 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456 tempest-TestServerVolumeAttachScenarioOldVersion-1244144456-project-member] Lock "0ac70112-5aaf-493c-b810-3ad743b483e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:14 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:18 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:51:18 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7082MB free_disk=25.319076538085938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Applying migration context for instance 8d000a70-0038-4b61-a514-694a492372a7 as it has an incoming, in-progress migration 21105692-beac-40bf-8317-90fba4dfdfc9. Migration status is finished {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 18:51:18 user nova-compute[72810]: INFO nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating resource usage from migration 21105692-beac-40bf-8317-90fba4dfdfc9
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d34dc998-2354-4eb5-9271-45b42b182047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 91b26445-f839-418c-ba6d-776b470b5461 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Migration 21105692-beac-40bf-8317-90fba4dfdfc9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:51:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:51:19 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:51:19 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:51:19 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:51:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:20 user nova-compute[72810]: INFO nova.compute.manager [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Unrescuing
Jul 31 18:51:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG nova.network.neutron [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG nova.network.neutron [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'flavor' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:21 user nova-compute[72810]: WARNING nova.compute.manager [req-f5242672-c2af-4c33-b2fc-1651bbe61fad req-67231b0d-5b5d-4122-b42d-547cdb0931ac service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:51:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829466.4306111, 0ac70112-5aaf-493c-b810-3ad743b483e6 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:51:21 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] VM Stopped (Lifecycle Event)
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b036945d-498e-4c7f-9669-00c5daa3d5b0 None None] [instance: 0ac70112-5aaf-493c-b810-3ad743b483e6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:21 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance destroyed successfully.
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:51:21 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [{"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-603fa513-0076-4a25-8d93-a6032d551afd" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:23 user nova-compute[72810]: WARNING nova.compute.manager [req-a5751021-96b5-4331-9036-48fa94492b1f req-15cb2b3a-4c82-462f-bd1d-780f5744949c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for a3bc5689-d177-44f9-9cd8-d8194d711be3 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829485.0393605, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:51:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Resumed (Lifecycle Event)
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-997928ef-3bf3-4986-90fe-e7f5f34f1d26 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:51:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829485.0434, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:51:25 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Started (Lifecycle Event)
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:25 user nova-compute[72810]: WARNING nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state None.
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:25 user nova-compute[72810]: DEBUG nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:25 user nova-compute[72810]: WARNING nova.compute.manager [req-66a566ea-873a-41ad-be11-b31c25a253a1 req-6e20af30-66d8-408d-8b5d-834d28b8189c service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state None.
Jul 31 18:51:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:51:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:37 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:51:37 user nova-compute[72810]: INFO nova.compute.claims [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Claim successful on node user
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:51:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.policy [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f26facd20ff42e89451e548379b789f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cad4967caa4975b8ff989a99d6f868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:51:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Creating image(s)
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "/opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "/opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk 1073741824" returned: 0 in 0.054s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:51:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Cannot resize image /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'migration_context' on Instance uuid aa8a0c74-8b74-4184-a07a-14cd99b71a37 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Successfully created port: b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Ensure instance console log exists: /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Successfully updated port: b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquired lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-changed-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Refreshing instance network info cache due to event network-changed-b543dfb8-c43c-4701-b842-db552617e4d8. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] Acquiring lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:51:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updating instance_info_cache with network_info: [{"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Releasing lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Instance network_info: |[{"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] Acquired lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Refreshing network info cache for port b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Start _get_guest_xml network_info=[{"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:51:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:51:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1005811729',display_name='tempest-ServersNegativeTestJSON-server-1005811729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1005811729',id=30,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-ahbbfd6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:51:38Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=aa8a0c74-8b74-4184-a07a-14cd99b71a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'pci_devices' on Instance uuid aa8a0c74-8b74-4184-a07a-14cd99b71a37 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:51:40 user nova-compute[72810]:   <uuid>aa8a0c74-8b74-4184-a07a-14cd99b71a37</uuid>
Jul 31 18:51:40 user nova-compute[72810]:   <name>instance-0000001e</name>
Jul 31 18:51:40 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:51:40 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:51:40 user nova-compute[72810]:   <metadata>
Jul 31 18:51:40 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:51:40 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:name>tempest-ServersNegativeTestJSON-server-1005811729</nova:name>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:51:40</nova:creationTime>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:51:40 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:51:40 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:owner>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:user uuid="8f26facd20ff42e89451e548379b789f">tempest-ServersNegativeTestJSON-96527336-project-member</nova:user>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:project uuid="d9cad4967caa4975b8ff989a99d6f868">tempest-ServersNegativeTestJSON-96527336</nova:project>
Jul 31 18:51:40 user nova-compute[72810]:       </nova:owner>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:51:40 user nova-compute[72810]:       <nova:ports>
Jul 31 18:51:40 user nova-compute[72810]:         <nova:port uuid="b543dfb8-c43c-4701-b842-db552617e4d8">
Jul 31 18:51:40 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 18:51:40 user nova-compute[72810]:         </nova:port>
Jul 31 18:51:40 user nova-compute[72810]:       </nova:ports>
Jul 31 18:51:40 user nova-compute[72810]:     </nova:instance>
Jul 31 18:51:40 user nova-compute[72810]:   </metadata>
Jul 31 18:51:40 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:51:40 user nova-compute[72810]:     <system>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="serial">aa8a0c74-8b74-4184-a07a-14cd99b71a37</entry>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="uuid">aa8a0c74-8b74-4184-a07a-14cd99b71a37</entry>
Jul 31 18:51:40 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:51:40 user nova-compute[72810]:     </system>
Jul 31 18:51:40 user nova-compute[72810]:   </sysinfo>
Jul 31 18:51:40 user nova-compute[72810]:   <os>
Jul 31 18:51:40 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:51:40 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:51:40 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:51:40 user nova-compute[72810]:   </os>
Jul 31 18:51:40 user nova-compute[72810]:   <features>
Jul 31 18:51:40 user nova-compute[72810]:     <acpi/>
Jul 31 18:51:40 user nova-compute[72810]:     <apic/>
Jul 31 18:51:40 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:51:40 user nova-compute[72810]:   </features>
Jul 31 18:51:40 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:51:40 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:51:40 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:51:40 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:51:40 user nova-compute[72810]:   </clock>
Jul 31 18:51:40 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:51:40 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:51:40 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:51:40 user nova-compute[72810]:   </cpu>
Jul 31 18:51:40 user nova-compute[72810]:   <devices>
Jul 31 18:51:40 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:51:40 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:51:40 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk"/>
Jul 31 18:51:40 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:51:40 user nova-compute[72810]:     </disk>
Jul 31 18:51:40 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:51:40 user nova-compute[72810]:       <mac address="fa:16:3e:b4:72:ad"/>
Jul 31 18:51:40 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:51:40 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:51:40 user nova-compute[72810]:       <target dev="tapb543dfb8-c4"/>
Jul 31 18:51:40 user nova-compute[72810]:     </interface>
Jul 31 18:51:40 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:51:40 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/console.log" append="off"/>
Jul 31 18:51:40 user nova-compute[72810]:     </serial>
Jul 31 18:51:40 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:51:40 user nova-compute[72810]:     <video>
Jul 31 18:51:40 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:51:40 user nova-compute[72810]:     </video>
Jul 31 18:51:40 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:51:40 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:51:40 user nova-compute[72810]:     </rng>
Jul 31 18:51:40 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:51:40 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:51:40 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:51:40 user nova-compute[72810]:     </memballoon>
Jul 31 18:51:40 user nova-compute[72810]:   </devices>
Jul 31 18:51:40 user nova-compute[72810]: </domain>
Jul 31 18:51:40 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1005811729',display_name='tempest-ServersNegativeTestJSON-server-1005811729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1005811729',id=30,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-ahbbfd6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:51:38Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=aa8a0c74-8b74-4184-a07a-14cd99b71a37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG os_vif [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb543dfb8-c4, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb543dfb8-c4, col_values=(('external_ids', {'iface-id': 'b543dfb8-c43c-4701-b842-db552617e4d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:72:ad', 'vm-uuid': 'aa8a0c74-8b74-4184-a07a-14cd99b71a37'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:40 user nova-compute[72810]: INFO os_vif [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4')
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] No VIF found with MAC fa:16:3e:b4:72:ad, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updated VIF entry in instance network info cache for port b543dfb8-c43c-4701-b842-db552617e4d8. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updating instance_info_cache with network_info: [{"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a918a66-a5e2-4d4c-ad04-6d3973d568d2 req-a21e7451-00e0-4ca3-954d-cb336f8cc015 service nova] Releasing lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] No waiting events found dispatching network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:41 user nova-compute[72810]: WARNING nova.compute.manager [req-2accb40d-c0bd-40d8-8a91-38cd0cf9964d req-b0ba964b-142d-4e23-a3e0-1ddf03e68e4f service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received unexpected event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 for instance with vm_state building and task_state spawning.
Jul 31 18:51:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829503.728155, aa8a0c74-8b74-4184-a07a-14cd99b71a37 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] VM Resumed (Lifecycle Event)
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Instance spawned successfully.
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829503.7295532, aa8a0c74-8b74-4184-a07a-14cd99b71a37 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] VM Started (Lifecycle Event)
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Took 5.45 seconds to spawn the instance on the hypervisor.
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:51:43 user nova-compute[72810]: INFO nova.compute.manager [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Took 6.21 seconds to build instance.
Jul 31 18:51:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b7a6f9aa-d7e3-4641-8e51-79413b7d8715 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.314s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] No waiting events found dispatching network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:43 user nova-compute[72810]: WARNING nova.compute.manager [req-fa2c94f4-ca0f-4c11-b391-06963b5886b3 req-69d21f37-ca7d-4277-b696-70ce4f691bc8 service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received unexpected event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 for instance with vm_state active and task_state None.
Jul 31 18:51:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:57 user nova-compute[72810]: INFO nova.compute.manager [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Unrescuing
Jul 31 18:51:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:51:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:51:57 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'flavor' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:51:58 user nova-compute[72810]: WARNING nova.compute.manager [req-126aa6cb-cf51-4bba-8459-8900891c12ba req-a77aef6e-456e-4a7a-be06-17e925dbc62e service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:51:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:51:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance destroyed successfully.
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:00 user nova-compute[72810]: WARNING nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:52:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:00 user nova-compute[72810]: WARNING nova.compute.manager [req-d9af894d-bf1d-4826-86bb-a2a3e3b835e7 req-bd65a077-3583-43c6-a117-6d1d7be8f959 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for 7148a69e-e93d-407a-ba32-71442fbaae2e due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829522.493484, 7148a69e-e93d-407a-ba32-71442fbaae2e => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:52:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Resumed (Lifecycle Event)
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e6c11318-1096-455a-83b7-91e3f451906a tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:52:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829522.4965103, 7148a69e-e93d-407a-ba32-71442fbaae2e => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:52:02 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Started (Lifecycle Event)
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:02 user nova-compute[72810]: WARNING nova.compute.manager [req-11df8c45-cc78-4ad7-90c3-e2030e5823e5 req-4603f9f6-3d28-4163-8571-d11f1ba15515 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state active and task_state None.
Jul 31 18:52:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-changed-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Refreshing instance network info cache due to event network-changed-f16d431d-e82b-417f-b76e-ebc877f65015. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:52:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] Acquiring lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] Acquired lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Refreshing network info cache for port f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:52:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updated VIF entry in instance network info cache for port f16d431d-e82b-417f-b76e-ebc877f65015. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:52:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating instance_info_cache with network_info: [{"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-830c3d5c-5a45-46d7-831e-a86dc4ee70d6 req-8379c11e-3732-4356-b67a-dc581003af86 service nova] Releasing lock "refresh_cache-d34dc998-2354-4eb5-9271-45b42b182047" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:08 user nova-compute[72810]: INFO nova.compute.manager [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attaching volume 1bee774d-e32c-4bb9-9808-05d473e0e255 to /dev/vdb
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.utils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16abfe-1fc6-48c9-b5cd-5f4b5c94aa55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ac70e-1967-4413-bef5-a635ebe35897]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d07de-c433-4df8-a89d-1dbf2218311c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e36dbd-ce81-43f4-bef5-fcd778e16054]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:08 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:52:08 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe14ee68-9449-4b79-af00-049cdbf6caf2]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG os_brick.utils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:08 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating existing volume attachment record: 5b67512a-eeae-425b-af5f-8b4a0ab18929 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:52:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-changed-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Refreshing instance network info cache due to event network-changed-2d35946e-5e64-4046-ba9e-4dfbe9d53b70. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:52:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] Acquiring lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] Acquired lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:09 user nova-compute[72810]: DEBUG nova.network.neutron [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Refreshing network info cache for port 2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:52:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:10 user nova-compute[72810]: DEBUG nova.network.neutron [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updated VIF entry in instance network info cache for port 2d35946e-5e64-4046-ba9e-4dfbe9d53b70. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:52:10 user nova-compute[72810]: DEBUG nova.network.neutron [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating instance_info_cache with network_info: [{"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0ce21318-c60c-41cd-809f-915985d5c2c6 req-153c367c-44e2-408f-89de-3447a69fcdaa service nova] Releasing lock "refresh_cache-91b26445-f839-418c-ba6d-776b470b5461" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Going to confirm migration 2 {{(pid=72810) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquired lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG nova.objects.instance [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'info_cache' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [{"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Releasing lock "refresh_cache-8d000a70-0038-4b61-a514-694a492372a7" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG nova.objects.instance [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'migration_context' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:12 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:52:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:52:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.567s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:12 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Deleted allocation for migration 21105692-beac-40bf-8317-90fba4dfdfc9
Jul 31 18:52:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dafd4d2e-64fd-40ff-88d7-282ab9f38edc tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.679s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:14 user nova-compute[72810]: INFO nova.compute.manager [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Attaching volume b1b5ff80-dee0-4138-9913-055ac2442798 to /dev/vdb
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.utils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671d70c-bdd3-4d69-91a7-fd39cfd5da6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca78464-de84-4fd5-8d38-b26fa09dbe9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bc3776-8ae2-4757-bb3c-3bf37694e6fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d519f75-6924-4680-8488-a5775ec0e6a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:14 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:52:14 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2f89b-9953-49d0-a11f-892cdd3174bc]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG os_brick.utils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:14 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating existing volume attachment record: 10aa974e-3d96-40ac-8f3e-03f0fb0d0469 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:52:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:16 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYprslVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:17 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:17 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:17 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c000ef-ebec-44a6-947a-318c0a173c43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:52:17 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[982905a7-19c3-4ceb-880e-756aff9526b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255] added
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6dd84-0a29-4536-ba8e-6098974a8e90]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d7e0b1-e927-435f-88e1-39bf43811670]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYprslVe {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYprslVe" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d478b0ba-ca35-409b-8237-4589c5525a11]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYprslVe'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583315d-f324-436a-ac12-5c57284e42e7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6d6630-a50c-49a4-a126-fdaf3a76618a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6520b556-2b32-4cf9-a804-27cdacdf7510]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260]
Jul 31 18:52:17 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274f649-4dfb-47f0-b64c-08570bbd2770]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f3ee7-198c-40cc-b0e1-08b0c61ba7e7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc443b77-7ccf-4883-9c27-b3d9fa32b2ed]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYprslVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26530303464363635', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303464363635', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:52:19 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:19 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:52:19 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:19 user nova-compute[72810]:   <serial>1bee774d-e32c-4bb9-9808-05d473e0e255</serial>
Jul 31 18:52:19 user nova-compute[72810]: </disk>
Jul 31 18:52:19 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No VIF found with MAC fa:16:3e:c3:27:e1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8a837a52-aef2-42d9-a15d-07cd7b7c7880 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.146s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:52:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:52:20 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=25.286514282226562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d34dc998-2354-4eb5-9271-45b42b182047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 91b26445-f839-418c-ba6d-776b470b5461 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:52:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:52:21 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:52:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:21 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:52:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:52:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzmujGaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:22 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:22 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:22 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea89c3b-f0a5-4cfe-9657-8350414df9a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:52:22 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a121c8-e8f3-40f7-b5b2-bb7ec0a8b032]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798] added
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[53232b32-dc86-479a-b8db-cb8133c8d5a5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab8972-3104-4e45-a3a3-fa54e5e396fb]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzmujGaF {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzmujGaF" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e3eaa-b8b4-4d0b-abbb-62f47556f75c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzmujGaF'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107ed0f-5707-4982-ae08-9f805b102129]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e40f9b6-088b-40e1-85a7-0be8b1f5f1eb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d662614-81ea-4827-afd0-58e1850f38dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260]
Jul 31 18:52:22 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba818d1f-dcb3-442a-891b-add13f88ec6a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8797a9ae-b8ff-4edc-8ae7-f4d4f9e7ec31]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)
Jul 31 18:52:22 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a5e8ec-edec-42ee-86aa-59bc804728cb]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzmujGaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26464363162616166', 'path': '/dev/sdf'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464363162616166', 'path': '/dev/sdf'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:52:23 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:23 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:23 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:23 user nova-compute[72810]:   <serial>b1b5ff80-dee0-4138-9913-055ac2442798</serial>
Jul 31 18:52:23 user nova-compute[72810]: </disk>
Jul 31 18:52:23 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] No VIF found with MAC fa:16:3e:53:b9:3c, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:24 user nova-compute[72810]: INFO nova.compute.manager [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attaching volume 2d25f141-a44e-4fbe-b485-ecade2e34576 to /dev/vdc
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a1af71b5-288f-4a9a-9de0-99a0461d2b8e tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.317s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.utils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ce848-00f7-4790-8502-c99f9cfdf7d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5712f51-a51f-48f0-b0b2-3ed26a8d7b3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7eeda-87d7-43b9-9817-b0a7ce47016e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d995e0fe-cffe-465c-8bc9-765d664b228a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:24 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5bb2e-daca-4126-ac6e-dd8bb1652ce5]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG os_brick.utils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating existing volume attachment record: 094332f1-5313-46e9-80db-0b10e52abd06 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:52:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:25 user nova-compute[72810]: INFO nova.compute.manager [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Detaching volume b1b5ff80-dee0-4138-9913-055ac2442798
Jul 31 18:52:25 user nova-compute[72810]: INFO nova.virt.block_device [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Attempting to driver detach volume b1b5ff80-dee0-4138-9913-055ac2442798 from mountpoint /dev/vdb
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Attempting to detach device vdb from instance 91b26445-f839-418c-ba6d-776b470b5461 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:25 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:25 user nova-compute[72810]:   <serial>b1b5ff80-dee0-4138-9913-055ac2442798</serial>
Jul 31 18:52:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:52:25 user nova-compute[72810]: </disk>
Jul 31 18:52:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance 91b26445-f839-418c-ba6d-776b470b5461 from the persistent domain config.
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91b26445-f839-418c-ba6d-776b470b5461 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:25 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:25 user nova-compute[72810]:   <serial>b1b5ff80-dee0-4138-9913-055ac2442798</serial>
Jul 31 18:52:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:52:25 user nova-compute[72810]: </disk>
Jul 31 18:52:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829545.669116, 91b26445-f839-418c-ba6d-776b470b5461 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:52:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully detached device vdb from instance 91b26445-f839-418c-ba6d-776b470b5461 from the live domain config.
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzmujGaF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91f1c28-7baa-4f15-a559-db20ac351b95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cce4bb-ffed-4869-ba85-709660e72e00]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 (non-flash)
Jul 31 18:52:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4257e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798'): ({'sdf'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Removing single pathed devices sdf {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1badc666-bf67-47f5-aaa9-510ac6e4faa6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1005d3e8-0da0-4151-8e1b-aee9b4b7101d]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Flushing IO for device /dev/sdf {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eea42b-89cb-43b3-97ac-bcf5d1ee78ce]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad6ad94-fbab-49e0-9703-6503365aa4c0]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4357d3-42a7-4766-ba73-4f4a18ebfebc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[547a3fd4-ab3e-492b-844a-6829b2dc3fba]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260]
Jul 31 18:52:25 user nova-compute[72810]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1b5ff80-dee0-4138-9913-055ac2442798 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f278f31-c3ec-4a1a-ac64-95c649e035c0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] <== disconnect_volume: return (302ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:52:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'flavor' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-30857526-41cd-44d8-96d3-3ffb0c7461e3 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.643s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'flavor' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:28 user nova-compute[72810]: INFO nova.compute.manager [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attaching volume 6394e6d7-e3dc-450c-8e88-5e412666dc4f to /dev/vdb
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea236e-1497-4295-9e31-bcb18a6aa282]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a86825-ad42-4aad-a772-b275c2890598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c4253-fc11-400a-b8f4-e060943a1c45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e99b017-e2e4-45bb-9780-f043f8695d91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:28 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:52:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[171f6647-cdd6-4d0b-a7b4-483ed35fc0cc]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:28 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating existing volume attachment record: 31f8f672-af45-4be7-85d8-6fd3e2db60e3 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:52:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkyFgiZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:32 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:32 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:32 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f0a364-4125-4c10-ad3c-992ada56b728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:52:32 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846c313-f918-4cec-83a9-85faa79eaa76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576] added
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[675da4ec-8bae-4883-8d7b-96f91aadccd9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2116983-cfbd-4c02-b054-d33fe2cc0db4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Acquiring lock "f92496b2-09a0-4552-aad6-c6422b355f26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "f92496b2-09a0-4552-aad6-c6422b355f26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkyFgiZI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wkyFgiZI" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a3badd-71e8-4660-95e1-daaa76badd35]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wkyFgiZI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fb903e-bf71-4e03-807e-6534da13898a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a057564-a967-4837-b8f6-159cf6e4e79b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:52:32 user nova-compute[72810]: INFO nova.compute.claims [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Claim successful on node user
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4efee3-3aad-4c39-9536-89e67657fbc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260]
Jul 31 18:52:32 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb7b38-ddfa-4a23-a025-653b8721a0fd]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cd11e9-34fa-4118-bfd6-948d502b59d6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae45a0-4194-478d-9ad2-adcefa59046c]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:52:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:52:32 user nova-compute[72810]: INFO nova.virt.block_device [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Booting with volume 638c03fa-6918-4521-baef-7cbaa98c2db4 at /dev/vda
Jul 31 18:52:32 user nova-compute[72810]: DEBUG nova.policy [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81a3f506952846dfbeeccf40e40a19a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d3a71a9ef46ed99a7bfddfafaf92d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.utils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[14445831-65b1-4701-a670-10479b641999]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[15314c8e-e101-4a33-94ff-04e285d9a938]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[630f6b2a-4aa1-4f53-a4e7-8fe48ea08fa6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[29664f42-57df-4503-b344-209e4fa8b938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:52:33 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:52:33 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac37a00-2576-4b74-8d79-bdef03f1cb10]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.utils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Updating existing volume attachment record: ac017f48-3b15-464b-aca6-661e941c183d {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkyFgiZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26130393763393163', 'path': '/dev/sdf'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130393763393163', 'path': '/dev/sdf'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:52:33 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:33 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:33 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:52:33 user nova-compute[72810]:   <serial>2d25f141-a44e-4fbe-b485-ecade2e34576</serial>
Jul 31 18:52:33 user nova-compute[72810]: </disk>
Jul 31 18:52:33 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Successfully created port: 7b4a8a5a-4dce-4f28-a573-d73225983c2e {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] No VIF found with MAC fa:16:3e:c3:27:e1, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ed7e64a0-fec1-4948-b28c-2a7b804236ca tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.785s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Successfully updated port: 7b4a8a5a-4dce-4f28-a573-d73225983c2e {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Acquiring lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Acquired lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Received event network-changed-7b4a8a5a-4dce-4f28-a573-d73225983c2e {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Refreshing instance network info cache due to event network-changed-7b4a8a5a-4dce-4f28-a573-d73225983c2e. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] Acquiring lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Updating instance_info_cache with network_info: [{"id": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "address": "fa:16:3e:4a:12:6a", "network": {"id": "38932e7e-0ba6-47e0-8c14-c93cff6d19d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-567500266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d3a71a9ef46ed99a7bfddfafaf92d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4a8a5a-4d", "ovs_interfaceid": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Releasing lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Instance network_info: |[{"id": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "address": "fa:16:3e:4a:12:6a", "network": {"id": "38932e7e-0ba6-47e0-8c14-c93cff6d19d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-567500266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d3a71a9ef46ed99a7bfddfafaf92d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4a8a5a-4d", "ovs_interfaceid": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] Acquired lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Refreshing network info cache for port 7b4a8a5a-4dce-4f28-a573-d73225983c2e {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Updated VIF entry in instance network info cache for port 7b4a8a5a-4dce-4f28-a573-d73225983c2e. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.network.neutron [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Updating instance_info_cache with network_info: [{"id": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "address": "fa:16:3e:4a:12:6a", "network": {"id": "38932e7e-0ba6-47e0-8c14-c93cff6d19d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-567500266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d3a71a9ef46ed99a7bfddfafaf92d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4a8a5a-4d", "ovs_interfaceid": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-00bc00c0-1acc-4b39-bc8d-d9150c6b712d req-b2f7e43b-0c01-41d2-9f9b-89f8b7acac15 service nova] Releasing lock "refresh_cache-f92496b2-09a0-4552-aad6-c6422b355f26" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:35 user nova-compute[72810]: INFO nova.compute.manager [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Detaching volume 1bee774d-e32c-4bb9-9808-05d473e0e255
Jul 31 18:52:35 user nova-compute[72810]: INFO nova.virt.block_device [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attempting to driver detach volume 1bee774d-e32c-4bb9-9808-05d473e0e255 from mountpoint /dev/vdb
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Attempting to detach device vdb from instance d34dc998-2354-4eb5-9271-45b42b182047 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:35 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:35 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:52:35 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:35 user nova-compute[72810]:   <serial>1bee774d-e32c-4bb9-9808-05d473e0e255</serial>
Jul 31 18:52:35 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:52:35 user nova-compute[72810]: </disk>
Jul 31 18:52:35 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdb from instance d34dc998-2354-4eb5-9271-45b42b182047 from the persistent domain config.
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d34dc998-2354-4eb5-9271-45b42b182047 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:35 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:35 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:52:35 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:35 user nova-compute[72810]:   <serial>1bee774d-e32c-4bb9-9808-05d473e0e255</serial>
Jul 31 18:52:35 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:52:35 user nova-compute[72810]: </disk>
Jul 31 18:52:35 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829556.1122017, d34dc998-2354-4eb5-9271-45b42b182047 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:52:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdb from instance d34dc998-2354-4eb5-9271-45b42b182047 from the live domain config.
Jul 31 18:52:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYprslVe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d06577-9442-407c-8430-07158f04ea27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c169df-a265-4db6-bc9a-2a490b21b51e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4241f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4993e069-c37b-415b-bb97-cd5b056a4402]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47fa46-5d3f-40b7-9c98-9323dc0ed0a8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab08837-4e42-4350-8dc8-b88150d7ca81]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d8f1f-a927-487a-a1b7-c81989d50f58]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0510e05-3212-4a39-941d-e93e31b47aca]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baffde7-7f93-4f77-a85e-1f7a938e2fb6]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260]
Jul 31 18:52:36 user nova-compute[72810]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bee774d-e32c-4bb9-9808-05d473e0e255 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3af5d-e1b8-4ded-af93-c220db50d89c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== disconnect_volume: return (294ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.075s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:36 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9426172b-5d31-4bae-b3f0-09676e4177f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:52:36 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667d894-9b3d-4b4b-bfa2-1542e6f11e5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f] added
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87c380-42d0-4ec8-89fd-24a7e2534237]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5376f18-d50e-4a66-b61c-1a1864f69fcb]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WifFZTJI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WifFZTJI" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c6501-ebc4-44b2-8a55-7593fde3d955]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WifFZTJI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e1723-7004-429c-9697-f3b5043d6489]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe3862-635d-4b74-aa10-1ad20c1129b3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9476cd5-9aa4-42af-86ac-0addc62c5d11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260]
Jul 31 18:52:36 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[062037a4-510e-4b11-8ebc-9669e3f931d8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0da3a4-1440-41db-8c60-61949a54a1b8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:36 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb79e3a0-8130-4e80-86f8-611a3ceaa4bd]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG nova.objects.instance [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-48d6305a-3721-4498-bab1-977e6c2cc6ed tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23532663266393563', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532663266393563', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG nova.objects.instance [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'flavor' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:52:37 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:37 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:52:37 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:52:37 user nova-compute[72810]:   <serial>6394e6d7-e3dc-450c-8e88-5e412666dc4f</serial>
Jul 31 18:52:37 user nova-compute[72810]: </disk>
Jul 31 18:52:37 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:37 user nova-compute[72810]: INFO nova.compute.manager [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Detaching volume 2d25f141-a44e-4fbe-b485-ecade2e34576
Jul 31 18:52:38 user nova-compute[72810]: INFO nova.virt.block_device [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Attempting to driver detach volume 2d25f141-a44e-4fbe-b485-ecade2e34576 from mountpoint /dev/vdc
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Attempting to detach device vdc from instance d34dc998-2354-4eb5-9271-45b42b182047 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:38 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:38 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:38 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:52:38 user nova-compute[72810]:   <serial>2d25f141-a44e-4fbe-b485-ecade2e34576</serial>
Jul 31 18:52:38 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:52:38 user nova-compute[72810]: </disk>
Jul 31 18:52:38 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdc from instance d34dc998-2354-4eb5-9271-45b42b182047 from the persistent domain config.
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d34dc998-2354-4eb5-9271-45b42b182047 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:52:38 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:38 user nova-compute[72810]:   <source dev="/dev/sdf"/>
Jul 31 18:52:38 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:52:38 user nova-compute[72810]:   <serial>2d25f141-a44e-4fbe-b485-ecade2e34576</serial>
Jul 31 18:52:38 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:52:38 user nova-compute[72810]: </disk>
Jul 31 18:52:38 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No VIF found with MAC fa:16:3e:36:17:be, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-34b4d332-59fe-48ba-bcd2-95442cf8082c tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.941s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829558.5775847, d34dc998-2354-4eb5-9271-45b42b182047 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:52:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully detached device vdc from instance d34dc998-2354-4eb5-9271-45b42b182047 from the live domain config.
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wkyFgiZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:38 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27cacb-898a-47a3-8e09-5a79322b9597]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6302d51-a25a-4471-987a-1b070e5ca4d6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 (non-flash)
Jul 31 18:52:38 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec16ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576'): ({'sdf'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Removing single pathed devices sdf {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a30efd4-e390-4ccd-88c8-ce27b48c88d0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[39239a61-9c11-4fc1-b400-2f3740b6a0ac]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Flushing IO for device /dev/sdf {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae071af-8f32-429e-836e-4312bd89f594]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dead79-e4a5-44c5-8ed5-efe9fca6bf98]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] SCSI volumes sdf have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c79b7e-d91d-4b99-b4d1-e94e8ea1ca08]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9fd88b-28a0-4724-9c4a-2fef798822bc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260]
Jul 31 18:52:38 user nova-compute[72810]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576, portal: 172.16.0.220,3260] successful.
Jul 31 18:52:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a938ba0f-a6b7-4a8f-9f25-243dfdf3167e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] <== disconnect_volume: return (279ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:52:39 user nova-compute[72810]: INFO nova.compute.manager [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Rescuing
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'flavor' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aa9b62b8-3db8-4261-80e0-d3dd42b3d22f tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.volume.cinder [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Update attachment failed for attachment ac017f48-3b15-464b-aca6-661e941c183d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb)
Jul 31 18:52:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Traceback (most recent call last):
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/compute/manager.py", line 2174, in _prep_block_device
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     driver_block_device.attach_block_devices(
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     _log_and_attach(device)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     bdm.attach(*attach_args, **attach_kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     ret_val = method(obj, context, *args, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     self._do_attach(context, instance, volume, volume_api,
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     self._volume_attach(context, volume, connector, instance,
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     connection_info = volume_api.attachment_update(
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     res = method(self, ctx, *args, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     res = method(self, ctx, attachment_id, *args, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     with excutils.save_and_reraise_exception():
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     self.force_reraise()
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     raise self.value
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     context, '3.44', skip_version_check=True).attachments.update(
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     return method.func(obj, *args, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     resp = self._update('/attachments/%s' % id, body)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     resp, body = self.api.client.put(url, body=body, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     return self._cs_request(url, 'PUT', **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     return self.request(url, method, **kwargs)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26]     raise exceptions.from_response(resp, body)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb)
Jul 31 18:52:39 user nova-compute[72810]: ERROR nova.compute.manager [instance: f92496b2-09a0-4552-aad6-c6422b355f26] 
Jul 31 18:52:39 user nova-compute[72810]: DEBUG nova.compute.claims [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Aborting claim: <nova.compute.claims.Claim object at 0x7f68dc4f0400> {{(pid=72810) abort /opt/stack/nova/nova/compute/claims.py:84}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.432s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Build of instance f92496b2-09a0-4552-aad6-c6422b355f26 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb) {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2644}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.utils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Build of instance f92496b2-09a0-4552-aad6-c6422b355f26 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c0 {{(pid=72810) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Jul 31 18:52:40 user nova-compute[72810]: ERROR nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Build of instance f92496b2-09a0-4552-aad6-c6422b355f26 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb): nova.exception.BuildAbortException: Build of instance f92496b2-09a0-4552-aad6-c6422b355f26 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb)
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Unplugging VIFs for instance {{(pid=72810) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2980}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1408086484',display_name='tempest-TestShelveInstance-server-1408086484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1408086484',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEAUgzg8tuc3zV9yz56l8+I3/GMJIG3vXcyeXJ/26otZyJslWPyAyVsVzE6v1wzqHtk7ZN8eKfGq0VhNXyNN2E81Etd3J7PJ88A19WTyg+tolooJaZxVRlaPLn2GG6auw==',key_name='tempest-TestShelveInstance-798471216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='773d3a71a9ef46ed99a7bfddfafaf92d',ramdisk_id='',reservation_id='r-8lzjcsge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-182653235',owner_user_name='tempest-TestShelveInstance-182653235-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:52:33Z,user_data=None,user_id='81a3f506952846dfbeeccf40e40a19a0',uuid=f92496b2-09a0-4552-aad6-c6422b355f26,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "address": "fa:16:3e:4a:12:6a", "network": {"id": "38932e7e-0ba6-47e0-8c14-c93cff6d19d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-567500266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d3a71a9ef46ed99a7bfddfafaf92d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4a8a5a-4d", "ovs_interfaceid": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Converting VIF {"id": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "address": "fa:16:3e:4a:12:6a", "network": {"id": "38932e7e-0ba6-47e0-8c14-c93cff6d19d2", "bridge": "br-int", "label": "tempest-TestShelveInstance-567500266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d3a71a9ef46ed99a7bfddfafaf92d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b4a8a5a-4d", "ovs_interfaceid": "7b4a8a5a-4dce-4f28-a573-d73225983c2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:12:6a,bridge_name='br-int',has_traffic_filtering=True,id=7b4a8a5a-4dce-4f28-a573-d73225983c2e,network=Network(38932e7e-0ba6-47e0-8c14-c93cff6d19d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4a8a5a-4d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG os_vif [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:12:6a,bridge_name='br-int',has_traffic_filtering=True,id=7b4a8a5a-4dce-4f28-a573-d73225983c2e,network=Network(38932e7e-0ba6-47e0-8c14-c93cff6d19d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4a8a5a-4d') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b4a8a5a-4d, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:52:40 user nova-compute[72810]: INFO os_vif [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:12:6a,bridge_name='br-int',has_traffic_filtering=True,id=7b4a8a5a-4dce-4f28-a573-d73225983c2e,network=Network(38932e7e-0ba6-47e0-8c14-c93cff6d19d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b4a8a5a-4d')
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Unplugged VIFs for instance {{(pid=72810) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3016}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:40 user nova-compute[72810]: WARNING nova.compute.manager [req-25b0b17b-22ac-4a80-b1ea-f8b79065444b req-f13a2c4a-83b8-483d-b0d0-0be44b855523 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state active and task_state rescuing.
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:40 user nova-compute[72810]: INFO nova.compute.manager [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Terminating instance
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance destroyed successfully.
Jul 31 18:52:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attempting a stable device rescue
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:52:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Creating image(s)
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'trusted_certs' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Instance destroyed successfully.
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lazy-loading 'resources' on Instance uuid d34dc998-2354-4eb5-9271-45b42b182047 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1923311124',display_name='tempest-AttachVolumeTestJSON-server-1923311124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1923311124',id=28,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOrsHDmSIX72rY01dsXeWPRHue6Xw8RY89LVagQrJuPR8YPY3TpZaf5UajW3s/K9uVUgjWuA/iDAw2w6BLAt5WFI/nyA7pWLDKjHotaVmAr2WOHuotVRNTRe+4uW+DH0w==',key_name='tempest-keypair-1315902083',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15a633ca9965410aa6ce5b2b86a6f198',ramdisk_id='',reservation_id='r-ttiza1zd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1714901238',owner_user_name='tempest-AttachVolumeTestJSON-1714901238-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:50:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b2bbbd7a792431688c8d575d2c71d21',uuid=d34dc998-2354-4eb5-9271-45b42b182047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converting VIF {"id": "f16d431d-e82b-417f-b76e-ebc877f65015", "address": "fa:16:3e:c3:27:e1", "network": {"id": "b2799f4f-ee23-4345-8a38-1cf11d801b3b", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-895439439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15a633ca9965410aa6ce5b2b86a6f198", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf16d431d-e8", "ovs_interfaceid": "f16d431d-e82b-417f-b76e-ebc877f65015", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG os_vif [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Took 1.82 seconds to deallocate network for instance.
Jul 31 18:52:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf16d431d-e8, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:42 user nova-compute[72810]: INFO os_vif [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:27:e1,bridge_name='br-int',has_traffic_filtering=True,id=f16d431d-e82b-417f-b76e-ebc877f65015,network=Network(b2799f4f-ee23-4345-8a38-1cf11d801b3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf16d431d-e8')
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Deleting instance files /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047_del
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Deletion of /opt/stack/data/nova/instances/d34dc998-2354-4eb5-9271-45b42b182047_del complete
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.virt.images [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] 9d31b188-5261-4cf9-a838-2bbb62cc480e was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.part /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Detaching volume: 638c03fa-6918-4521-baef-7cbaa98c2db4 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3208}}
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Detaching volume 638c03fa-6918-4521-baef-7cbaa98c2db4
Jul 31 18:52:42 user nova-compute[72810]: INFO nova.compute.manager [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Took 1.66 seconds to destroy the instance on the hypervisor.
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:52:42 user nova-compute[72810]: ERROR nova.virt.block_device [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Unable to call for a driver detach of volume 638c03fa-6918-4521-baef-7cbaa98c2db4 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance f92496b2-09a0-4552-aad6-c6422b355f26 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:638c03fa-6918-4521-baef-7cbaa98c2db4/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:2d25f141-a44e-4fbe-b485-ecade2e34576 was not found.).). (HTTP 500) (Request-ID: req-92fc2088-cb34-4dfa-ad3c-3c2e069507bb)
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:42 user nova-compute[72810]: WARNING nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state active and task_state rescuing.
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-unplugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] No waiting events found dispatching network-vif-unplugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-unplugged-f16d431d-e82b-417f-b76e-ebc877f65015 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Acquiring lock "d34dc998-2354-4eb5-9271-45b42b182047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] Lock "d34dc998-2354-4eb5-9271-45b42b182047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] No waiting events found dispatching network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:42 user nova-compute[72810]: WARNING nova.compute.manager [req-d821130d-fe7d-4927-9bf3-3b055444c4a9 req-0c3f567d-2b81-435b-87c9-e1e8cae59bf9 service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received unexpected event network-vif-plugged-f16d431d-e82b-417f-b76e-ebc877f65015 for instance with vm_state active and task_state deleting.
Jul 31 18:52:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] [instance: f92496b2-09a0-4552-aad6-c6422b355f26] Deleting volume: 638c03fa-6918-4521-baef-7cbaa98c2db4 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.part /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.converted" returned: 0 in 0.731s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Deleted allocations for instance f92496b2-09a0-4552-aad6-c6422b355f26
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-c3a34364-43bf-41fa-be3f-c5b314918166 tempest-TestShelveInstance-182653235 tempest-TestShelveInstance-182653235-project-member] Lock "f92496b2-09a0-4552-aad6-c6422b355f26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.874s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.323s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08 --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08,backing_fmt=raw /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08,backing_fmt=raw /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue" returned: 0 in 0.049s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "1b0d86dff2ae88a894518dcc86095c9f93f53e08" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'migration_context' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start _get_guest_xml network_info=[{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "vif_mac": "fa:16:3e:36:17:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9d31b188-5261-4cf9-a838-2bbb62cc480e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'efede298-b109-4259-af3d-beb9cdca7f6c', 'attached_at': '', 'detached_at': '', 'volume_id': '6394e6d7-e3dc-450c-8e88-5e412666dc4f', 'serial': '6394e6d7-e3dc-450c-8e88-5e412666dc4f'}, 'attachment_id': '31f8f672-af45-4be7-85d8-6fd3e2db60e3', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'resources' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'numa_topology' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:43 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:52:43 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'vcpu_model' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:52:43 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:43 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:52:43 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29744e9-a574-4a3d-bbaf-59fc226be58f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WifFZTJI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 18:52:43 user nova-compute[72810]: node.name = iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f
Jul 31 18:52:43 user nova-compute[72810]: node.tpgt = -1
Jul 31 18:52:43 user nova-compute[72810]: node.startup = automatic
Jul 31 18:52:43 user nova-compute[72810]: node.leading_login = No
Jul 31 18:52:43 user nova-compute[72810]: iface.iscsi_ifacename = default
Jul 31 18:52:43 user nova-compute[72810]: iface.net_ifacename = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.ipaddress = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.prefix_len = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.hwaddress = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.transport_name = tcp
Jul 31 18:52:43 user nova-compute[72810]: iface.initiatorname = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.vlan_id = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.vlan_priority = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.vlan_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.iface_num = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.mtu = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.port = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.bootproto = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.subnet_mask = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.gateway = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_alt_client_id = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_dns = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_learn_iqn = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_vendor_id_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_vendor_id = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.dhcp_slp_da = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.fragmentation = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.gratuitous_arp = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.incoming_forwarding = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.tos_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.tos = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.ttl = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.delayed_ack = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.tcp_nagle = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.tcp_wsf_state = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.tcp_wsf = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.tcp_timer_scale = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.tcp_timestamp = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.redirect = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.def_task_mgmt_timeout = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.header_digest = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.data_digest = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.immediate_data = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.initial_r2t = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.data_seq_inorder = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.data_pdu_inorder = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.erl = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.max_receive_data_len = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.first_burst_len = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.max_outstanding_r2t = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.max_burst_len = 0
Jul 31 18:52:43 user nova-compute[72810]: iface.chap_auth = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.bidi_chap = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.strict_login_compliance = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.discovery_auth = <empty>
Jul 31 18:52:43 user nova-compute[72810]: iface.discovery_logout = <empty>
Jul 31 18:52:43 user nova-compute[72810]: node.discovery_address = <empty>
Jul 31 18:52:43 user nova-compute[72810]: node.discovery_port = 0
Jul 31 18:52:43 user nova-compute[72810]: node.discovery_type = static
Jul 31 18:52:43 user nova-compute[72810]: node.session.initial_cmdsn = 0
Jul 31 18:52:43 user nova-compute[72810]: node.session.initial_login_retry_max = 8
Jul 31 18:52:43 user nova-compute[72810]: node.session.xmit_thread_priority = -20
Jul 31 18:52:43 user nova-compute[72810]: node.session.cmds_max = 128
Jul 31 18:52:43 user nova-compute[72810]: node.session.queue_depth = 32
Jul 31 18:52:43 user nova-compute[72810]: node.session.nr_sessions = 1
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.authmethod = CHAP
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.username = WifFZTJI
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.password = ***
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.username_in = <empty>
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.password_in = <empty>
Jul 31 18:52:43 user nova-compute[72810]: node.session.auth.chap_algs = MD5
Jul 31 18:52:43 user nova-compute[72810]: node.session.timeo.replacement_timeout = 120
Jul 31 18:52:43 user nova-compute[72810]: node.session.err_timeo.abort_timeout = 15
Jul 31 18:52:43 user nova-compute[72810]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 18:52:43 user nova-compute[72810]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 18:52:43 user nova-compute[72810]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.FastAbort = Yes
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.InitialR2T = No
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.ImmediateData = Yes
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.MaxConnections = 1
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 18:52:43 user nova-compute[72810]: node.session.iscsi.ERL = 0
Jul 31 18:52:43 user nova-compute[72810]: node.session.scan = manual
Jul 31 18:52:43 user nova-compute[72810]: node.session.reopen_max = 0
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].address = 172.16.0.220
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].port = 3260
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].startup = manual
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].tcp.window_size = 524288
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].tcp.type_of_service = 0
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].timeo.logout_timeout = 15
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].timeo.login_timeout = 15
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].timeo.auth_timeout = 45
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.DataDigest = None
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.IFMarker = No
Jul 31 18:52:43 user nova-compute[72810]: node.conn[0].iscsi.OFMarker = No
Jul 31 18:52:43 user nova-compute[72810]: # END RECORD
Jul 31 18:52:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-f759939f-9543-4781-a752-211dfdd48c9e req-61b5015d-0a9a-43d9-a94f-5afa51375b2c service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Received event network-vif-deleted-f16d431d-e82b-417f-b76e-ebc877f65015 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:43 user nova-compute[72810]: INFO nova.compute.manager [req-f759939f-9543-4781-a752-211dfdd48c9e req-61b5015d-0a9a-43d9-a94f-5afa51375b2c service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Neutron deleted interface f16d431d-e82b-417f-b76e-ebc877f65015; detaching it from the instance and deleting it from the info cache
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-f759939f-9543-4781-a752-211dfdd48c9e req-61b5015d-0a9a-43d9-a94f-5afa51375b2c service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Took 1.22 seconds to deallocate network for instance.
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edffcf1-4547-47e5-b473-2f6a3e6ee7e6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-f759939f-9543-4781-a752-211dfdd48c9e req-61b5015d-0a9a-43d9-a94f-5afa51375b2c service nova] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Detach interface failed, port_id=f16d431d-e82b-417f-b76e-ebc877f65015, reason: Instance d34dc998-2354-4eb5-9271-45b42b182047 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a192a4f1-3f1f-4070-bd84-caf257ffccb9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WifFZTJI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WifFZTJI" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[025152a2-1f0b-4821-9b9f-c074e3b991a8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WifFZTJI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68dc41-baef-42e5-8dfb-0406ced752d7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac631b2-868b-4516-b880-204ef8bf3db4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:52:43 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:52:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] HCTL ('36', '0', '0', 0) found on session 38 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74dc5c5-0d68-435a-b8d5-c692f7fa39bd]: (4, ('0 0 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Searching for a device in session 38 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '23532663266393563', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532663266393563', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1640869050',display_name='tempest-ServerStableDeviceRescueTest-server-1640869050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1640869050',id=26,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjq/9hLgIc/BWvoj3i2M2iVNz9YZ0FWCqbG4fqtwtY0wKc3glxTBL4Kcpisq2xQNjkM33Wav55i/Dwmwocj54DMI42AqFyXOq7+lloEhjjhJNw33RyncuYvha+OlgRzpA==',key_name='tempest-keypair-121170053',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='331edd1d741f45708524dece1d4879c2',ramdisk_id='',reservation_id='r-sb1pgzt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1101694858',owner_user_name='tempest-ServerStableDeviceRescueTest-1101694858-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5682f35ef70a4d85ac694eaee676c4f3',uuid=efede298-b109-4259-af3d-beb9cdca7f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "vif_mac": "fa:16:3e:36:17:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converting VIF {"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "vif_mac": "fa:16:3e:36:17:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'pci_devices' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:52:43 user nova-compute[72810]:   <uuid>efede298-b109-4259-af3d-beb9cdca7f6c</uuid>
Jul 31 18:52:43 user nova-compute[72810]:   <name>instance-0000001a</name>
Jul 31 18:52:43 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:52:43 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:52:43 user nova-compute[72810]:   <metadata>
Jul 31 18:52:43 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:52:43 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1640869050</nova:name>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:52:43</nova:creationTime>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:52:43 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:52:43 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:owner>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:user uuid="5682f35ef70a4d85ac694eaee676c4f3">tempest-ServerStableDeviceRescueTest-1101694858-project-member</nova:user>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:project uuid="331edd1d741f45708524dece1d4879c2">tempest-ServerStableDeviceRescueTest-1101694858</nova:project>
Jul 31 18:52:43 user nova-compute[72810]:       </nova:owner>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:52:43 user nova-compute[72810]:       <nova:ports>
Jul 31 18:52:43 user nova-compute[72810]:         <nova:port uuid="49ac8945-2c3b-4732-8c63-e2fbce057f76">
Jul 31 18:52:43 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 18:52:43 user nova-compute[72810]:         </nova:port>
Jul 31 18:52:43 user nova-compute[72810]:       </nova:ports>
Jul 31 18:52:43 user nova-compute[72810]:     </nova:instance>
Jul 31 18:52:43 user nova-compute[72810]:   </metadata>
Jul 31 18:52:43 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:52:43 user nova-compute[72810]:     <system>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="serial">efede298-b109-4259-af3d-beb9cdca7f6c</entry>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="uuid">efede298-b109-4259-af3d-beb9cdca7f6c</entry>
Jul 31 18:52:43 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:52:43 user nova-compute[72810]:     </system>
Jul 31 18:52:43 user nova-compute[72810]:   </sysinfo>
Jul 31 18:52:43 user nova-compute[72810]:   <os>
Jul 31 18:52:43 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:52:43 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:52:43 user nova-compute[72810]:   </os>
Jul 31 18:52:43 user nova-compute[72810]:   <features>
Jul 31 18:52:43 user nova-compute[72810]:     <acpi/>
Jul 31 18:52:43 user nova-compute[72810]:     <apic/>
Jul 31 18:52:43 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:52:43 user nova-compute[72810]:   </features>
Jul 31 18:52:43 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:52:43 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:52:43 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:52:43 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:52:43 user nova-compute[72810]:   </clock>
Jul 31 18:52:43 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:52:43 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:52:43 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:52:43 user nova-compute[72810]:   </cpu>
Jul 31 18:52:43 user nova-compute[72810]:   <devices>
Jul 31 18:52:43 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:52:43 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:52:43 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk"/>
Jul 31 18:52:43 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:52:43 user nova-compute[72810]:     </disk>
Jul 31 18:52:43 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:52:43 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:52:43 user nova-compute[72810]:       <source dev="/dev/sde"/>
Jul 31 18:52:43 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:52:43 user nova-compute[72810]:       <serial>6394e6d7-e3dc-450c-8e88-5e412666dc4f</serial>
Jul 31 18:52:43 user nova-compute[72810]:     </disk>
Jul 31 18:52:43 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:52:43 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:52:43 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue"/>
Jul 31 18:52:43 user nova-compute[72810]:       <target dev="vdc" bus="virtio"/>
Jul 31 18:52:43 user nova-compute[72810]:       <boot order="1"/>
Jul 31 18:52:43 user nova-compute[72810]:     </disk>
Jul 31 18:52:43 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:52:43 user nova-compute[72810]:       <mac address="fa:16:3e:36:17:be"/>
Jul 31 18:52:43 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:52:43 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:52:43 user nova-compute[72810]:       <target dev="tap49ac8945-2c"/>
Jul 31 18:52:43 user nova-compute[72810]:     </interface>
Jul 31 18:52:43 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:52:43 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/console.log" append="off"/>
Jul 31 18:52:43 user nova-compute[72810]:     </serial>
Jul 31 18:52:43 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:52:43 user nova-compute[72810]:     <video>
Jul 31 18:52:43 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:52:43 user nova-compute[72810]:     </video>
Jul 31 18:52:43 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:52:43 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:52:43 user nova-compute[72810]:     </rng>
Jul 31 18:52:43 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:52:43 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:52:43 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:52:43 user nova-compute[72810]:     </memballoon>
Jul 31 18:52:43 user nova-compute[72810]:   </devices>
Jul 31 18:52:43 user nova-compute[72810]: </domain>
Jul 31 18:52:43 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:52:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance destroyed successfully.
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] No VIF found with MAC fa:16:3e:36:17:be, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:52:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:43 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Deleted allocations for instance d34dc998-2354-4eb5-9271-45b42b182047
Jul 31 18:52:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-32123b03-2b06-4c01-91d7-356023636a98 tempest-AttachVolumeTestJSON-1714901238 tempest-AttachVolumeTestJSON-1714901238-project-member] Lock "d34dc998-2354-4eb5-9271-45b42b182047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:45 user nova-compute[72810]: WARNING nova.compute.manager [req-faa71a36-a510-4663-a989-17082d4c1da0 req-a6e594db-447f-4d9d-a5be-28629780260b service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state active and task_state rescuing.
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for efede298-b109-4259-af3d-beb9cdca7f6c due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829567.416871, efede298-b109-4259-af3d-beb9cdca7f6c => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:52:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Resumed (Lifecycle Event)
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6f71d8ce-ac50-42bc-913b-642aaed2ed37 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:52:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829567.4187229, efede298-b109-4259-af3d-beb9cdca7f6c => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:52:47 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Started (Lifecycle Event)
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:52:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:52:47 user nova-compute[72810]: WARNING nova.compute.manager [req-d89b209d-d61b-4e33-ab69-7183fd5737b3 req-bfdfa680-68dc-4ff9-acc0-7578f73b7a53 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state rescued and task_state None.
Jul 31 18:52:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:52:57 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829561.3887303, d34dc998-2354-4eb5-9271-45b42b182047 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:52:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d34dc998-2354-4eb5-9271-45b42b182047] VM Stopped (Lifecycle Event)
Jul 31 18:52:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-5124cd5c-5ccd-43d7-94ed-578139ed7a88 None None] [instance: d34dc998-2354-4eb5-9271-45b42b182047] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:52:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:53:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:53:12 user nova-compute[72810]: INFO nova.compute.claims [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Claim successful on node user
Jul 31 18:53:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:53:12 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.policy [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef3882653e7244108f590048754d86b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb86a791f5464179b055746ede494239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:53:12 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Creating image(s)
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "/opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.128s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk 1073741824" returned: 0 in 0.050s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Successfully created port: f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Cannot resize image /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'migration_context' on Instance uuid 60e683d2-fe34-4191-8c7c-153fe32f5ed0 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Ensure instance console log exists: /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Successfully updated port: f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-changed-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Refreshing instance network info cache due to event network-changed-f673ecf9-963d-4267-ad5d-9687bdc88600. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] Acquiring lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updating instance_info_cache with network_info: [{"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Instance network_info: |[{"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] Acquired lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Refreshing network info cache for port f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Start _get_guest_xml network_info=[{"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:53:14 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:14 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841836347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841836347',id=32,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-ifli6bii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:13Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=60e683d2-fe34-4191-8c7c-153fe32f5ed0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid 60e683d2-fe34-4191-8c7c-153fe32f5ed0 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:53:14 user nova-compute[72810]:   <uuid>60e683d2-fe34-4191-8c7c-153fe32f5ed0</uuid>
Jul 31 18:53:14 user nova-compute[72810]:   <name>instance-00000020</name>
Jul 31 18:53:14 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:53:14 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:53:14 user nova-compute[72810]:   <metadata>
Jul 31 18:53:14 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:53:14 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1841836347</nova:name>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:53:14</nova:creationTime>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:53:14 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:53:14 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:owner>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:53:14 user nova-compute[72810]:       </nova:owner>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:53:14 user nova-compute[72810]:       <nova:ports>
Jul 31 18:53:14 user nova-compute[72810]:         <nova:port uuid="f673ecf9-963d-4267-ad5d-9687bdc88600">
Jul 31 18:53:14 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 18:53:14 user nova-compute[72810]:         </nova:port>
Jul 31 18:53:14 user nova-compute[72810]:       </nova:ports>
Jul 31 18:53:14 user nova-compute[72810]:     </nova:instance>
Jul 31 18:53:14 user nova-compute[72810]:   </metadata>
Jul 31 18:53:14 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:53:14 user nova-compute[72810]:     <system>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="serial">60e683d2-fe34-4191-8c7c-153fe32f5ed0</entry>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="uuid">60e683d2-fe34-4191-8c7c-153fe32f5ed0</entry>
Jul 31 18:53:14 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:53:14 user nova-compute[72810]:     </system>
Jul 31 18:53:14 user nova-compute[72810]:   </sysinfo>
Jul 31 18:53:14 user nova-compute[72810]:   <os>
Jul 31 18:53:14 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:53:14 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:53:14 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:53:14 user nova-compute[72810]:   </os>
Jul 31 18:53:14 user nova-compute[72810]:   <features>
Jul 31 18:53:14 user nova-compute[72810]:     <acpi/>
Jul 31 18:53:14 user nova-compute[72810]:     <apic/>
Jul 31 18:53:14 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:53:14 user nova-compute[72810]:   </features>
Jul 31 18:53:14 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:53:14 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:53:14 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:53:14 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:53:14 user nova-compute[72810]:   </clock>
Jul 31 18:53:14 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:53:14 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:53:14 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:53:14 user nova-compute[72810]:   </cpu>
Jul 31 18:53:14 user nova-compute[72810]:   <devices>
Jul 31 18:53:14 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:53:14 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:53:14 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk"/>
Jul 31 18:53:14 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:53:14 user nova-compute[72810]:     </disk>
Jul 31 18:53:14 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:53:14 user nova-compute[72810]:       <mac address="fa:16:3e:9d:b8:87"/>
Jul 31 18:53:14 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:14 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:53:14 user nova-compute[72810]:       <target dev="tapf673ecf9-96"/>
Jul 31 18:53:14 user nova-compute[72810]:     </interface>
Jul 31 18:53:14 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:53:14 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/console.log" append="off"/>
Jul 31 18:53:14 user nova-compute[72810]:     </serial>
Jul 31 18:53:14 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:53:14 user nova-compute[72810]:     <video>
Jul 31 18:53:14 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:14 user nova-compute[72810]:     </video>
Jul 31 18:53:14 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:53:14 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:53:14 user nova-compute[72810]:     </rng>
Jul 31 18:53:14 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:53:14 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:53:14 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:53:14 user nova-compute[72810]:     </memballoon>
Jul 31 18:53:14 user nova-compute[72810]:   </devices>
Jul 31 18:53:14 user nova-compute[72810]: </domain>
Jul 31 18:53:14 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841836347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841836347',id=32,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-ifli6bii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:13Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=60e683d2-fe34-4191-8c7c-153fe32f5ed0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG os_vif [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf673ecf9-96, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf673ecf9-96, col_values=(('external_ids', {'iface-id': 'f673ecf9-963d-4267-ad5d-9687bdc88600', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:b8:87', 'vm-uuid': '60e683d2-fe34-4191-8c7c-153fe32f5ed0'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:14 user nova-compute[72810]: INFO os_vif [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96')
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:53:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:9d:b8:87, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updated VIF entry in instance network info cache for port f673ecf9-963d-4267-ad5d-9687bdc88600. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updating instance_info_cache with network_info: [{"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-40b88869-c801-4622-be3e-6a134d5b907c req-88eef4c0-bbb3-4e7d-b047-a1f522123277 service nova] Releasing lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:15 user nova-compute[72810]: INFO nova.compute.manager [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Terminating instance
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-272f2322-a7b7-47e2-9489-910a70ec2483 req-75a818ab-f720-4194-a645-fb6c58978f16 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Instance destroyed successfully.
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lazy-loading 'resources' on Instance uuid 91b26445-f839-418c-ba6d-776b470b5461 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1014895116',display_name='tempest-AttachVolumeNegativeTest-server-1014895116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1014895116',id=29,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzjaOXDFqpoHTYZQbuDk84IkMqE32NVkn9Y5RC20D1OPgOEtLPGqMunM48rUYQxhxd3yuR21+deQUG3WuPSa8Bj1tFTSodX7Dd1UbFlg9TO7Av5S5o4JR44h51ZcJTahA==',key_name='tempest-keypair-867897121',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:50:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4ba7112dc8b41f8aad49ea1ce030afb',ramdisk_id='',reservation_id='r-bw6y0gpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1544720465',owner_user_name='tempest-AttachVolumeNegativeTest-1544720465-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84386ba984b649c69a4a1110fe7954dc',uuid=91b26445-f839-418c-ba6d-776b470b5461,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converting VIF {"id": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "address": "fa:16:3e:53:b9:3c", "network": {"id": "dcdee5b8-0120-4773-b410-8011e6907baa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1169375450-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4ba7112dc8b41f8aad49ea1ce030afb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d35946e-5e", "ovs_interfaceid": "2d35946e-5e64-4046-ba9e-4dfbe9d53b70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG os_vif [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d35946e-5e, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: INFO os_vif [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:b9:3c,bridge_name='br-int',has_traffic_filtering=True,id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70,network=Network(dcdee5b8-0120-4773-b410-8011e6907baa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d35946e-5e')
Jul 31 18:53:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Deleting instance files /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461_del
Jul 31 18:53:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Deletion of /opt/stack/data/nova/instances/91b26445-f839-418c-ba6d-776b470b5461_del complete
Jul 31 18:53:16 user nova-compute[72810]: INFO nova.compute.manager [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 31 18:53:16 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.compute.manager [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG nova.compute.manager [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:16 user nova-compute[72810]: WARNING nova.compute.manager [req-12186565-3642-412e-892a-92234240ddb1 req-8c4c305c-4db8-4c59-86b8-cbc10b21e86d service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received unexpected event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with vm_state building and task_state spawning.
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:17 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Took 0.96 seconds to deallocate network for instance.
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-80e12881-b9ea-489c-9212-ccdbbbdda274 req-409d04e9-c9a7-41a5-84c8-9daf500576a7 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-deleted-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: INFO nova.compute.manager [req-80e12881-b9ea-489c-9212-ccdbbbdda274 req-409d04e9-c9a7-41a5-84c8-9daf500576a7 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Neutron deleted interface 2d35946e-5e64-4046-ba9e-4dfbe9d53b70; detaching it from the instance and deleting it from the info cache
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.network.neutron [req-80e12881-b9ea-489c-9212-ccdbbbdda274 req-409d04e9-c9a7-41a5-84c8-9daf500576a7 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-80e12881-b9ea-489c-9212-ccdbbbdda274 req-409d04e9-c9a7-41a5-84c8-9daf500576a7 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Detach interface failed, port_id=2d35946e-5e64-4046-ba9e-4dfbe9d53b70, reason: Instance 91b26445-f839-418c-ba6d-776b470b5461 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:17 user nova-compute[72810]: WARNING nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state deleted and task_state None.
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:17 user nova-compute[72810]: WARNING nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state deleted and task_state None.
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:17 user nova-compute[72810]: WARNING nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state deleted and task_state None.
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:17 user nova-compute[72810]: WARNING nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-unplugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state deleted and task_state None.
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Acquiring lock "91b26445-f839-418c-ba6d-776b470b5461-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] Lock "91b26445-f839-418c-ba6d-776b470b5461-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] No waiting events found dispatching network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:17 user nova-compute[72810]: WARNING nova.compute.manager [req-b2589f93-06b5-4cf1-8129-fbdb28c9e3b3 req-800a982a-7914-40d1-a44b-ef40062b06c5 service nova] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Received unexpected event network-vif-plugged-2d35946e-5e64-4046-ba9e-4dfbe9d53b70 for instance with vm_state deleted and task_state None.
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.189s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Deleted allocations for instance 91b26445-f839-418c-ba6d-776b470b5461
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3280bb30-03b2-47ec-b756-111afc6938e9 tempest-AttachVolumeNegativeTest-1544720465 tempest-AttachVolumeNegativeTest-1544720465-project-member] Lock "91b26445-f839-418c-ba6d-776b470b5461" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829598.7537758, 60e683d2-fe34-4191-8c7c-153fe32f5ed0 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] VM Resumed (Lifecycle Event)
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Instance spawned successfully.
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829598.7579043, 60e683d2-fe34-4191-8c7c-153fe32f5ed0 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] VM Started (Lifecycle Event)
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:18 user nova-compute[72810]: WARNING nova.compute.manager [req-5875c4b2-ac49-4868-b6e4-3a8cd127c8b4 req-2376d0da-65d5-4c1e-a209-6a38fbfbbb37 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received unexpected event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with vm_state building and task_state spawning.
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:53:18 user nova-compute[72810]: INFO nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Took 6.21 seconds to spawn the instance on the hypervisor.
Jul 31 18:53:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: INFO nova.compute.manager [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Took 6.95 seconds to build instance.
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3f90cfb5-663c-47d6-abea-ff31a9776612 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.039s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:21 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:21 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=25.233722686767578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:53:21 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:53:22 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:53:22 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:53:22 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:53:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:28 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:53:28 user nova-compute[72810]: INFO nova.compute.claims [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Claim successful on node user
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:53:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.policy [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f26facd20ff42e89451e548379b789f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9cad4967caa4975b8ff989a99d6f868', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:53:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Creating image(s)
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "/opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "/opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "/opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.166s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk 1073741824" returned: 0 in 0.053s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Cannot resize image /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'migration_context' on Instance uuid 6468fb96-c156-4495-a3f6-927ceb70fac9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Ensure instance console log exists: /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Successfully created port: 21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829596.5307295, 91b26445-f839-418c-ba6d-776b470b5461 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:53:31 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 91b26445-f839-418c-ba6d-776b470b5461] VM Stopped (Lifecycle Event)
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-49bbcd84-d542-401e-9265-c46915c74120 None None] [instance: 91b26445-f839-418c-ba6d-776b470b5461] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Successfully updated port: 21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquired lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-changed-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Refreshing instance network info cache due to event network-changed-21f1c0e5-0a07-4181-be53-76a32aac14ea. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] Acquiring lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Updating instance_info_cache with network_info: [{"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Releasing lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Instance network_info: |[{"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] Acquired lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Refreshing network info cache for port 21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Start _get_guest_xml network_info=[{"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:53:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1249792172',display_name='tempest-ServersNegativeTestJSON-server-1249792172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1249792172',id=33,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-p5ugs0ot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:30Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=6468fb96-c156-4495-a3f6-927ceb70fac9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'pci_devices' on Instance uuid 6468fb96-c156-4495-a3f6-927ceb70fac9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:53:32 user nova-compute[72810]:   <uuid>6468fb96-c156-4495-a3f6-927ceb70fac9</uuid>
Jul 31 18:53:32 user nova-compute[72810]:   <name>instance-00000021</name>
Jul 31 18:53:32 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:53:32 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:53:32 user nova-compute[72810]:   <metadata>
Jul 31 18:53:32 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:53:32 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:name>tempest-ServersNegativeTestJSON-server-1249792172</nova:name>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:53:32</nova:creationTime>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:53:32 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:53:32 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:owner>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:user uuid="8f26facd20ff42e89451e548379b789f">tempest-ServersNegativeTestJSON-96527336-project-member</nova:user>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:project uuid="d9cad4967caa4975b8ff989a99d6f868">tempest-ServersNegativeTestJSON-96527336</nova:project>
Jul 31 18:53:32 user nova-compute[72810]:       </nova:owner>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:53:32 user nova-compute[72810]:       <nova:ports>
Jul 31 18:53:32 user nova-compute[72810]:         <nova:port uuid="21f1c0e5-0a07-4181-be53-76a32aac14ea">
Jul 31 18:53:32 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 18:53:32 user nova-compute[72810]:         </nova:port>
Jul 31 18:53:32 user nova-compute[72810]:       </nova:ports>
Jul 31 18:53:32 user nova-compute[72810]:     </nova:instance>
Jul 31 18:53:32 user nova-compute[72810]:   </metadata>
Jul 31 18:53:32 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:53:32 user nova-compute[72810]:     <system>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="serial">6468fb96-c156-4495-a3f6-927ceb70fac9</entry>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="uuid">6468fb96-c156-4495-a3f6-927ceb70fac9</entry>
Jul 31 18:53:32 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:53:32 user nova-compute[72810]:     </system>
Jul 31 18:53:32 user nova-compute[72810]:   </sysinfo>
Jul 31 18:53:32 user nova-compute[72810]:   <os>
Jul 31 18:53:32 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:53:32 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:53:32 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:53:32 user nova-compute[72810]:   </os>
Jul 31 18:53:32 user nova-compute[72810]:   <features>
Jul 31 18:53:32 user nova-compute[72810]:     <acpi/>
Jul 31 18:53:32 user nova-compute[72810]:     <apic/>
Jul 31 18:53:32 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:53:32 user nova-compute[72810]:   </features>
Jul 31 18:53:32 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:53:32 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:53:32 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:53:32 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:53:32 user nova-compute[72810]:   </clock>
Jul 31 18:53:32 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:53:32 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:53:32 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:53:32 user nova-compute[72810]:   </cpu>
Jul 31 18:53:32 user nova-compute[72810]:   <devices>
Jul 31 18:53:32 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:53:32 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:53:32 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk"/>
Jul 31 18:53:32 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:53:32 user nova-compute[72810]:     </disk>
Jul 31 18:53:32 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:53:32 user nova-compute[72810]:       <mac address="fa:16:3e:78:27:31"/>
Jul 31 18:53:32 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:32 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:53:32 user nova-compute[72810]:       <target dev="tap21f1c0e5-0a"/>
Jul 31 18:53:32 user nova-compute[72810]:     </interface>
Jul 31 18:53:32 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:53:32 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/console.log" append="off"/>
Jul 31 18:53:32 user nova-compute[72810]:     </serial>
Jul 31 18:53:32 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:53:32 user nova-compute[72810]:     <video>
Jul 31 18:53:32 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:32 user nova-compute[72810]:     </video>
Jul 31 18:53:32 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:53:32 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:53:32 user nova-compute[72810]:     </rng>
Jul 31 18:53:32 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:53:32 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:53:32 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:53:32 user nova-compute[72810]:     </memballoon>
Jul 31 18:53:32 user nova-compute[72810]:   </devices>
Jul 31 18:53:32 user nova-compute[72810]: </domain>
Jul 31 18:53:32 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1249792172',display_name='tempest-ServersNegativeTestJSON-server-1249792172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1249792172',id=33,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-p5ugs0ot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:30Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=6468fb96-c156-4495-a3f6-927ceb70fac9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG os_vif [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21f1c0e5-0a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21f1c0e5-0a, col_values=(('external_ids', {'iface-id': '21f1c0e5-0a07-4181-be53-76a32aac14ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:27:31', 'vm-uuid': '6468fb96-c156-4495-a3f6-927ceb70fac9'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:32 user nova-compute[72810]: INFO os_vif [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a')
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] No VIF found with MAC fa:16:3e:78:27:31, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Updated VIF entry in instance network info cache for port 21f1c0e5-0a07-4181-be53-76a32aac14ea. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG nova.network.neutron [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Updating instance_info_cache with network_info: [{"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e38d415c-cf9a-4612-849e-ce688e3b1845 req-b8152570-23ec-443e-af4d-61e7b57a9bbf service nova] Releasing lock "refresh_cache-6468fb96-c156-4495-a3f6-927ceb70fac9" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] No waiting events found dispatching network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:33 user nova-compute[72810]: WARNING nova.compute.manager [req-2333679a-f54f-4507-993f-732df7a19a5c req-4160d706-0360-4646-95ed-564408eb950e service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received unexpected event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea for instance with vm_state building and task_state spawning.
Jul 31 18:53:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829615.9782267, 6468fb96-c156-4495-a3f6-927ceb70fac9 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:53:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] VM Resumed (Lifecycle Event)
Jul 31 18:53:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:53:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:53:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Instance spawned successfully.
Jul 31 18:53:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] No waiting events found dispatching network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:36 user nova-compute[72810]: WARNING nova.compute.manager [req-7d0bb701-dfc6-4672-9c99-d75fbc73772b req-ea7988fa-3bec-4b8c-8c60-9829069f6292 service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received unexpected event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea for instance with vm_state building and task_state spawning.
Jul 31 18:53:36 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829615.9794729, 6468fb96-c156-4495-a3f6-927ceb70fac9 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:53:36 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] VM Started (Lifecycle Event)
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:53:36 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:53:36 user nova-compute[72810]: INFO nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Took 6.38 seconds to spawn the instance on the hypervisor.
Jul 31 18:53:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:53:36 user nova-compute[72810]: INFO nova.compute.manager [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Took 7.38 seconds to build instance.
Jul 31 18:53:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-217d29e7-e786-4c16-9e5f-b73bc20d924e tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.478s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing instance network info cache due to event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:53:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:49 user nova-compute[72810]: DEBUG nova.network.neutron [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updated VIF entry in instance network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdd90c09-b2f0-4e86-827e-87503789e8a2 req-0eb1da4d-150b-4fb8-bbc6-62e2d0a193a2 service nova] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:50 user nova-compute[72810]: INFO nova.compute.manager [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Detaching volume 62986dd0-2bba-4d7c-90dd-9a46967d3f6c
Jul 31 18:53:50 user nova-compute[72810]: INFO nova.virt.block_device [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Attempting to driver detach volume 62986dd0-2bba-4d7c-90dd-9a46967d3f6c from mountpoint /dev/vdb
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Attempting to detach device vdb from instance 7148a69e-e93d-407a-ba32-71442fbaae2e from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:53:50 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:53:50 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:53:50 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:53:50 user nova-compute[72810]:   <serial>62986dd0-2bba-4d7c-90dd-9a46967d3f6c</serial>
Jul 31 18:53:50 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:53:50 user nova-compute[72810]: </disk>
Jul 31 18:53:50 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:53:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully detached device vdb from instance 7148a69e-e93d-407a-ba32-71442fbaae2e from the persistent domain config.
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7148a69e-e93d-407a-ba32-71442fbaae2e from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:53:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:53:50 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:53:50 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:53:50 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:53:50 user nova-compute[72810]:   <serial>62986dd0-2bba-4d7c-90dd-9a46967d3f6c</serial>
Jul 31 18:53:50 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:53:50 user nova-compute[72810]: </disk>
Jul 31 18:53:50 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829631.1411114, 7148a69e-e93d-407a-ba32-71442fbaae2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:53:51 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully detached device vdb from instance 7148a69e-e93d-407a-ba32-71442fbaae2e from the live domain config.
Jul 31 18:53:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXOiIbjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:53:51 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b6efd-c836-4af8-8585-3ba37f560ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b464c3d-3a19-4495-87ad-01da27026d7c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:53:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:53:51 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:53:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc537d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d8c35-c23d-4b85-804c-251fc3b7549b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afff679-9078-437b-966e-9aa1ea8d84a1]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ca58b-c17b-46fc-8013-b97081618f34]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac5d328-e0a3-4aa3-b81a-94af9d9ba85a]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaea5ab-35ea-42ca-a34f-c9d7db3d34d5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbd90bc-6d34-4ab4-a35a-3a841024b9f5]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260]
Jul 31 18:53:51 user nova-compute[72810]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c, portal: 172.16.0.220,3260] successful.
Jul 31 18:53:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62986dd0-2bba-4d7c-90dd-9a46967d3f6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3519ceb-f19f-4d4c-b482-390ecf628c26]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] <== disconnect_volume: return (295ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:53:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing instance network info cache due to event network-changed-f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Refreshing network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'flavor' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77b212ab-da76-4b38-bb62-24e8ef5505fd tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updated VIF entry in instance network info cache for port f26fc84b-a55b-40eb-a612-379f0ad7a380. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ed931ca8-d4f6-42e3-a82b-b225e2127d79 req-d0956e6f-1449-4977-8b0d-a2d29b4251f6 service nova] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:53:53 user nova-compute[72810]: INFO nova.compute.claims [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Claim successful on node user
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:53:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.policy [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b213b31483f48d2b541e5488c8e73b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0bb7ce61d874fb1b2bddfcdedd81ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:53:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Creating image(s)
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "/opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "/opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "/opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.162s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk 1073741824" returned: 0 in 0.050s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:53:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Successfully created port: 1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Cannot resize image /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'migration_context' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Ensure instance console log exists: /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Successfully updated port: 1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-changed-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Refreshing instance network info cache due to event network-changed-1ce1b861-fdfd-4e44-a44c-1e921c72c548. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] Acquiring lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] Acquired lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Refreshing network info cache for port 1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:53:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-747c9122-d678-47f7-966e-a0bdd93c797c req-a70fd50c-3294-46c2-85a2-61439f844af3 service nova] Releasing lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquired lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating instance_info_cache with network_info: [{"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Releasing lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance network_info: |[{"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Start _get_guest_xml network_info=[{"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:53:56 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:56 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-198065800',display_name='tempest-SnapshotDataIntegrityTests-server-198065800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-198065800',id=34,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvj7uJDxic3Z6EA744e4C+quKGXeEMMiDFZCFqP5lfn22WJAolgG3x9ymx97beVoz6153Zo4+2mAzdaSe9I4GvgaT/kogKZREQ5hQRZww7a1Wv31pOUcTC5onngE4ihRA==',key_name='tempest-keypair-696562392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0bb7ce61d874fb1b2bddfcdedd81ed7',ramdisk_id='',reservation_id='r-gi7yg9tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1070122162',owner_user_name='tempest-SnapshotDataIntegrityTests-1070122162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b213b31483f48d2b541e5488c8e73b3',uuid=7736ea8f-3b6d-4d0d-83b8-ec75684dcbba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converting VIF {"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'pci_devices' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:53:56 user nova-compute[72810]:   <uuid>7736ea8f-3b6d-4d0d-83b8-ec75684dcbba</uuid>
Jul 31 18:53:56 user nova-compute[72810]:   <name>instance-00000022</name>
Jul 31 18:53:56 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:53:56 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:53:56 user nova-compute[72810]:   <metadata>
Jul 31 18:53:56 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:53:56 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-198065800</nova:name>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:53:56</nova:creationTime>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:53:56 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:53:56 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:owner>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:user uuid="8b213b31483f48d2b541e5488c8e73b3">tempest-SnapshotDataIntegrityTests-1070122162-project-member</nova:user>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:project uuid="a0bb7ce61d874fb1b2bddfcdedd81ed7">tempest-SnapshotDataIntegrityTests-1070122162</nova:project>
Jul 31 18:53:56 user nova-compute[72810]:       </nova:owner>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:53:56 user nova-compute[72810]:       <nova:ports>
Jul 31 18:53:56 user nova-compute[72810]:         <nova:port uuid="1ce1b861-fdfd-4e44-a44c-1e921c72c548">
Jul 31 18:53:56 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:53:56 user nova-compute[72810]:         </nova:port>
Jul 31 18:53:56 user nova-compute[72810]:       </nova:ports>
Jul 31 18:53:56 user nova-compute[72810]:     </nova:instance>
Jul 31 18:53:56 user nova-compute[72810]:   </metadata>
Jul 31 18:53:56 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:53:56 user nova-compute[72810]:     <system>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="serial">7736ea8f-3b6d-4d0d-83b8-ec75684dcbba</entry>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="uuid">7736ea8f-3b6d-4d0d-83b8-ec75684dcbba</entry>
Jul 31 18:53:56 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:53:56 user nova-compute[72810]:     </system>
Jul 31 18:53:56 user nova-compute[72810]:   </sysinfo>
Jul 31 18:53:56 user nova-compute[72810]:   <os>
Jul 31 18:53:56 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:53:56 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:53:56 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:53:56 user nova-compute[72810]:   </os>
Jul 31 18:53:56 user nova-compute[72810]:   <features>
Jul 31 18:53:56 user nova-compute[72810]:     <acpi/>
Jul 31 18:53:56 user nova-compute[72810]:     <apic/>
Jul 31 18:53:56 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:53:56 user nova-compute[72810]:   </features>
Jul 31 18:53:56 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:53:56 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:53:56 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:53:56 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:53:56 user nova-compute[72810]:   </clock>
Jul 31 18:53:56 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:53:56 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:53:56 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:53:56 user nova-compute[72810]:   </cpu>
Jul 31 18:53:56 user nova-compute[72810]:   <devices>
Jul 31 18:53:56 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:53:56 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:53:56 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk"/>
Jul 31 18:53:56 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:53:56 user nova-compute[72810]:     </disk>
Jul 31 18:53:56 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:53:56 user nova-compute[72810]:       <mac address="fa:16:3e:dd:61:29"/>
Jul 31 18:53:56 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:56 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:53:56 user nova-compute[72810]:       <target dev="tap1ce1b861-fd"/>
Jul 31 18:53:56 user nova-compute[72810]:     </interface>
Jul 31 18:53:56 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:53:56 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/console.log" append="off"/>
Jul 31 18:53:56 user nova-compute[72810]:     </serial>
Jul 31 18:53:56 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:53:56 user nova-compute[72810]:     <video>
Jul 31 18:53:56 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:53:56 user nova-compute[72810]:     </video>
Jul 31 18:53:56 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:53:56 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:53:56 user nova-compute[72810]:     </rng>
Jul 31 18:53:56 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:53:56 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:53:56 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:53:56 user nova-compute[72810]:     </memballoon>
Jul 31 18:53:56 user nova-compute[72810]:   </devices>
Jul 31 18:53:56 user nova-compute[72810]: </domain>
Jul 31 18:53:56 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-198065800',display_name='tempest-SnapshotDataIntegrityTests-server-198065800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-198065800',id=34,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvj7uJDxic3Z6EA744e4C+quKGXeEMMiDFZCFqP5lfn22WJAolgG3x9ymx97beVoz6153Zo4+2mAzdaSe9I4GvgaT/kogKZREQ5hQRZww7a1Wv31pOUcTC5onngE4ihRA==',key_name='tempest-keypair-696562392',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0bb7ce61d874fb1b2bddfcdedd81ed7',ramdisk_id='',reservation_id='r-gi7yg9tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1070122162',owner_user_name='tempest-SnapshotDataIntegrityTests-1070122162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:53:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b213b31483f48d2b541e5488c8e73b3',uuid=7736ea8f-3b6d-4d0d-83b8-ec75684dcbba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converting VIF {"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG os_vif [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ce1b861-fd, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ce1b861-fd, col_values=(('external_ids', {'iface-id': '1ce1b861-fdfd-4e44-a44c-1e921c72c548', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:61:29', 'vm-uuid': '7736ea8f-3b6d-4d0d-83b8-ec75684dcbba'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:56 user nova-compute[72810]: INFO os_vif [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd')
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:53:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No VIF found with MAC fa:16:3e:dd:61:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] No waiting events found dispatching network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:53:58 user nova-compute[72810]: WARNING nova.compute.manager [req-77e18a24-ccb9-4afc-8ccc-4bc8b5bcc821 req-e4d0238a-f0d7-4de0-8498-848b2b29efb9 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received unexpected event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 for instance with vm_state building and task_state spawning.
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:53:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829640.3780818, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] VM Resumed (Lifecycle Event)
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance spawned successfully.
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] No waiting events found dispatching network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:00 user nova-compute[72810]: WARNING nova.compute.manager [req-0fc69fcb-cfae-48ea-93b8-4bb80fdb2407 req-1331223c-608c-4e79-979c-a1852245af82 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received unexpected event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 for instance with vm_state building and task_state spawning.
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829640.379615, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] VM Started (Lifecycle Event)
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Took 6.10 seconds to spawn the instance on the hypervisor.
Jul 31 18:54:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:54:00 user nova-compute[72810]: INFO nova.compute.manager [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Took 6.89 seconds to build instance.
Jul 31 18:54:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a9eaff10-9b48-4883-9e38-2f4a01aa5b3e tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:02 user nova-compute[72810]: INFO nova.compute.manager [None req-5e1bf805-578e-41ec-a646-b8019079ac4d tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Get console output
Jul 31 18:54:02 user nova-compute[72810]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 31 18:54:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:18 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:20 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:54:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:54:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:54:23 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7183MB free_disk=25.137603759765625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7148a69e-e93d-407a-ba32-71442fbaae2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d000a70-0038-4b61-a514-694a492372a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 6468fb96-c156-4495-a3f6-927ceb70fac9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:54:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.571s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:54:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:54:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [{"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-7148a69e-e93d-407a-ba32-71442fbaae2e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:54:30 user nova-compute[72810]: INFO nova.compute.manager [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Unrescuing
Jul 31 18:54:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:54:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:54:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:54:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'flavor' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:31 user nova-compute[72810]: WARNING nova.compute.manager [req-aebae4b6-2c8e-4feb-95ae-161de417be92 req-15616772-2394-4876-8fab-9250cdb013aa service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:54:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance destroyed successfully.
Jul 31 18:54:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:33 user nova-compute[72810]: WARNING nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:54:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing instance network info cache due to event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updated VIF entry in instance network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing instance network info cache due to event network-changed-49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Refreshing network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updated VIF entry in instance network info cache for port 49ac8945-2c3b-4732-8c63-e2fbce057f76. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:54:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-14f9b59c-af87-467f-87bf-f8192becedd4 req-4aeb056a-ff24-44b2-b854-624f4373c6e0 service nova] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for efede298-b109-4259-af3d-beb9cdca7f6c due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829675.5464947, efede298-b109-4259-af3d-beb9cdca7f6c => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:54:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Resumed (Lifecycle Event)
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d733aadf-e6bd-4703-9d51-9e1cf6ef68d1 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:35 user nova-compute[72810]: WARNING nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:35 user nova-compute[72810]: WARNING nova.compute.manager [req-35b3d9f7-e40a-488c-8134-08331db27cf3 req-c4ef80a5-64ea-4116-b3d9-fc8eaf690cc4 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829675.5476422, efede298-b109-4259-af3d-beb9cdca7f6c => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:54:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Started (Lifecycle Event)
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:54:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:40 user nova-compute[72810]: INFO nova.compute.manager [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Terminating instance
Jul 31 18:54:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-130e9b39-55ca-4d30-beb9-fbc220d957df req-7b996790-7a52-4833-85cc-38b3f7edcc8d service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-unplugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Instance destroyed successfully.
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.objects.instance [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid 7148a69e-e93d-407a-ba32-71442fbaae2e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-177221635',display_name='tempest-ServerRescueNegativeTestJSON-server-177221635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-177221635',id=24,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMgtIHJMOkOY43Ou5M6fEyasQ9qqg4CbBsglARvf6ql9ZGf8quXSJhnruUMbXrBMk6+Tysmz5zDC2niFR9jiaUPrqTz0SUcY55gdmIbIWWQRtOidTnxeUVzPw7xTvsugQ==',key_name='tempest-keypair-1658891605',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-vf5ys7ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=7148a69e-e93d-407a-ba32-71442fbaae2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "address": "fa:16:3e:eb:f2:29", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf26fc84b-a5", "ovs_interfaceid": "f26fc84b-a55b-40eb-a612-379f0ad7a380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG os_vif [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf26fc84b-a5, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:54:41 user nova-compute[72810]: INFO os_vif [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f2:29,bridge_name='br-int',has_traffic_filtering=True,id=f26fc84b-a55b-40eb-a612-379f0ad7a380,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf26fc84b-a5')
Jul 31 18:54:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Deleting instance files /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e_del
Jul 31 18:54:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Deletion of /opt/stack/data/nova/instances/7148a69e-e93d-407a-ba32-71442fbaae2e_del complete
Jul 31 18:54:41 user nova-compute[72810]: INFO nova.compute.manager [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 31 18:54:41 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:54:41 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:54:42 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:54:42 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Took 0.90 seconds to deallocate network for instance.
Jul 31 18:54:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-3f882384-5450-483e-a149-3677a6562a8b req-278d6412-c819-4481-905e-ce908a5b01fd service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-deleted-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:43 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Deleted allocations for instance 7148a69e-e93d-407a-ba32-71442fbaae2e
Jul 31 18:54:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-28f49309-6eda-4d14-b6e5-c110ff50dbb3 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] Acquiring lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] Lock "7148a69e-e93d-407a-ba32-71442fbaae2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:54:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] No waiting events found dispatching network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:54:43 user nova-compute[72810]: WARNING nova.compute.manager [req-9840cd88-5474-432d-882d-158fee05e172 req-013d2170-2da7-4a72-94f8-a7f35a8eb9cc service nova] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Received unexpected event network-vif-plugged-f26fc84b-a55b-40eb-a612-379f0ad7a380 for instance with vm_state deleted and task_state None.
Jul 31 18:54:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:56 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829681.6906, 7148a69e-e93d-407a-ba32-71442fbaae2e => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:54:56 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] VM Stopped (Lifecycle Event)
Jul 31 18:54:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4c0e8831-c30d-4ed6-9e30-04e16851a3c0 None None] [instance: 7148a69e-e93d-407a-ba32-71442fbaae2e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:54:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:54:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:03 user nova-compute[72810]: INFO nova.compute.manager [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Terminating instance
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:55:03 user nova-compute[72810]: INFO nova.compute.manager [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] instance snapshotting
Jul 31 18:55:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Beginning live snapshot process
Jul 31 18:55:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-b1fc54ab-32d8-4bd7-bea0-cab4ca474ce4 req-e83800ed-5a63-4f3d-86c7-ef7c1bff5c8e service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-unplugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Instance destroyed successfully.
Jul 31 18:55:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'resources' on Instance uuid 8d000a70-0038-4b61-a514-694a492372a7 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-658508307',display_name='tempest-ServerActionsTestOtherA-server-658508307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-658508307',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-f94uik4q',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:52:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=8d000a70-0038-4b61-a514-694a492372a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "address": "fa:16:3e:09:27:db", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d7abd07-ce", "ovs_interfaceid": "2d7abd07-ce56-49ef-860e-be4aab4c2841", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_vif [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d7abd07-ce, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:55:04 user nova-compute[72810]: INFO os_vif [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:27:db,bridge_name='br-int',has_traffic_filtering=True,id=2d7abd07-ce56-49ef-860e-be4aab4c2841,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d7abd07-ce')
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjntpELw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:55:04 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.compute.manager [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Detaching volume 6394e6d7-e3dc-450c-8e88-5e412666dc4f
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e6243-439f-4bb6-9f59-5ecf78d420b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8fe8fc-0865-4425-a6df-da5786a84b8b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec3808b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.block_device [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Attempting to driver detach volume 6394e6d7-e3dc-450c-8e88-5e412666dc4f from mountpoint /dev/vdb
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Attempting to detach device vdb from instance efede298-b109-4259-af3d-beb9cdca7f6c from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:55:04 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:55:04 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:55:04 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:55:04 user nova-compute[72810]:   <serial>6394e6d7-e3dc-450c-8e88-5e412666dc4f</serial>
Jul 31 18:55:04 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:55:04 user nova-compute[72810]: </disk>
Jul 31 18:55:04 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec6b58-e582-4404-9a0a-019d66162286]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Successfully detached device vdb from instance efede298-b109-4259-af3d-beb9cdca7f6c from the persistent domain config.
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance efede298-b109-4259-af3d-beb9cdca7f6c from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:55:04 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:55:04 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:55:04 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:55:04 user nova-compute[72810]:   <serial>6394e6d7-e3dc-450c-8e88-5e412666dc4f</serial>
Jul 31 18:55:04 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:55:04 user nova-compute[72810]: </disk>
Jul 31 18:55:04 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9809a2-3c0a-4683-b6e0-6e4a8625b005]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd3f4e-18bb-4c14-b86a-10e64d1eb113]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee.delta 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a466caa-fb54-4faa-9a72-b613a68e2940]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.085s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0970d-918d-499e-a20c-50794945b143]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee.delta 1073741824" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[656ff4a5-d44b-4797-a3ee-d779c66fc8f0]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260]
Jul 31 18:55:04 user nova-compute[72810]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83, portal: 172.16.0.220,3260] successful.
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e03ab-5ec8-440a-8ba0-cff75772ef83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[64480dd7-63a3-4a52-961e-ee20d9f1ad76]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] <== disconnect_volume: return (418ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Deleting instance files /opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7_del
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Deletion of /opt/stack/data/nova/instances/8d000a70-0038-4b61-a514-694a492372a7_del complete
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.compute.manager [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Took 1.42 seconds to destroy the instance on the hypervisor.
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829704.6744184, efede298-b109-4259-af3d-beb9cdca7f6c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:55:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Successfully detached device vdb from instance efede298-b109-4259-af3d-beb9cdca7f6c from the live domain config.
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WifFZTJI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:55:04 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[55033e33-463d-410c-acff-cf77f3527641]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ac565-ac4b-4cc8-98fd-d7d11e0e4e2d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:04 user nova-compute[72810]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f (non-flash)
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec382200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9458e365-1747-4f8d-9425-eacdcc31e1b8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88ec142-7ead-4eee-830d-7017032770cd]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ee0aab-5d81-41f6-971c-befb1c46620a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0175516a-2834-4148-953b-7232396bf5ad]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb0d87-3647-495c-987a-623f3a24af52]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee1b6f-f507-4f97-9c65-8a6cc1656b8d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260]
Jul 31 18:55:04 user nova-compute[72810]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f, portal: 172.16.0.220,3260] successful.
Jul 31 18:55:04 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6394e6d7-e3dc-450c-8e88-5e412666dc4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8fa10f-f1c5-47c2-9569-260c62460864]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] <== disconnect_volume: return (295ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:55:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-758adddd-b141-4ecb-9780-60267c7d92fd req-11a5f8ad-9048-4dfd-ac90-6227421e0632 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-deleted-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:05 user nova-compute[72810]: INFO nova.compute.manager [req-758adddd-b141-4ecb-9780-60267c7d92fd req-11a5f8ad-9048-4dfd-ac90-6227421e0632 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Neutron deleted interface 2d7abd07-ce56-49ef-860e-be4aab4c2841; detaching it from the instance and deleting it from the info cache
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-758adddd-b141-4ecb-9780-60267c7d92fd req-11a5f8ad-9048-4dfd-ac90-6227421e0632 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] Acquiring lock "8d000a70-0038-4b61-a514-694a492372a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] Lock "8d000a70-0038-4b61-a514-694a492372a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] No waiting events found dispatching network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:05 user nova-compute[72810]: WARNING nova.compute.manager [req-b941c2c9-59db-41bf-ad53-15393f49c80e req-7ae990bc-2015-4168-831f-1489735f78ed service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Received unexpected event network-vif-plugged-2d7abd07-ce56-49ef-860e-be4aab4c2841 for instance with vm_state active and task_state deleting.
Jul 31 18:55:05 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Took 1.24 seconds to deallocate network for instance.
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-758adddd-b141-4ecb-9780-60267c7d92fd req-11a5f8ad-9048-4dfd-ac90-6227421e0632 service nova] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Detach interface failed, port_id=2d7abd07-ce56-49ef-860e-be4aab4c2841, reason: Instance 8d000a70-0038-4b61-a514-694a492372a7 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:55:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 21626880 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:55:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 18:55:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 18:55:06 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:55:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee.delta /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:06 user nova-compute[72810]: INFO nova.compute.manager [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Took 1.11 seconds to detach 1 volumes for instance.
Jul 31 18:55:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Deleting volume: 048e03ab-5ec8-440a-8ba0-cff75772ef83 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 18:55:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:07 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee.delta /opt/stack/data/nova/instances/snapshots/tmpngb0_7j3/5457a6c0d3dd458f88654dde0248a0ee" returned: 0 in 0.829s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Snapshot extracted, beginning image upload
Jul 31 18:55:07 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:55:07 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:55:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:07 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Deleted allocations for instance 8d000a70-0038-4b61-a514-694a492372a7
Jul 31 18:55:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9e116f9c-b0ea-4643-97f2-2b146fbbc095 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "8d000a70-0038-4b61-a514-694a492372a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.621s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:08 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'flavor' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d2d483ea-5932-4222-9aa1-ce395a70c2e5 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.683s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Snapshot image upload complete
Jul 31 18:55:09 user nova-compute[72810]: INFO nova.compute.manager [None req-fbe5d02e-43e6-405d-a4ea-27dd0b1ea817 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Took 6.48 seconds to snapshot the instance on the hypervisor.
Jul 31 18:55:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:55:18 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829703.9409559, 8d000a70-0038-4b61-a514-694a492372a7 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:55:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8d000a70-0038-4b61-a514-694a492372a7] VM Stopped (Lifecycle Event)
Jul 31 18:55:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b38e6dbd-5b5e-4334-bd6e-7207a6809fb6 None None] [instance: 8d000a70-0038-4b61-a514-694a492372a7] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:19 user nova-compute[72810]: INFO nova.compute.manager [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Terminating instance
Jul 31 18:55:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-unplugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] No waiting events found dispatching network-vif-unplugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc9068e7-5132-4ef6-8651-1dff16d3e8a2 req-fbf38c6d-6939-4b15-ae5d-c6952f8c7e4b service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-unplugged-21f1c0e5-0a07-4181-be53-76a32aac14ea for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Instance destroyed successfully.
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.objects.instance [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'resources' on Instance uuid 6468fb96-c156-4495-a3f6-927ceb70fac9 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1249792172',display_name='tempest-ServersNegativeTestJSON-server-1249792172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1249792172',id=33,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:53:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-p5ugs0ot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:53:36Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=6468fb96-c156-4495-a3f6-927ceb70fac9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "address": "fa:16:3e:78:27:31", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21f1c0e5-0a", "ovs_interfaceid": "21f1c0e5-0a07-4181-be53-76a32aac14ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG os_vif [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21f1c0e5-0a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:20 user nova-compute[72810]: INFO os_vif [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:27:31,bridge_name='br-int',has_traffic_filtering=True,id=21f1c0e5-0a07-4181-be53-76a32aac14ea,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21f1c0e5-0a')
Jul 31 18:55:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Deleting instance files /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9_del
Jul 31 18:55:20 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Deletion of /opt/stack/data/nova/instances/6468fb96-c156-4495-a3f6-927ceb70fac9_del complete
Jul 31 18:55:20 user nova-compute[72810]: INFO nova.compute.manager [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Took 1.03 seconds to destroy the instance on the hypervisor.
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:20 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Took 0.55 seconds to deallocate network for instance.
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Deleted allocations for instance 6468fb96-c156-4495-a3f6-927ceb70fac9
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-51970203-a8ee-43aa-8d43-277a741df412 tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] Acquiring lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] Lock "6468fb96-c156-4495-a3f6-927ceb70fac9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] No waiting events found dispatching network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:21 user nova-compute[72810]: WARNING nova.compute.manager [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received unexpected event network-vif-plugged-21f1c0e5-0a07-4181-be53-76a32aac14ea for instance with vm_state deleted and task_state None.
Jul 31 18:55:21 user nova-compute[72810]: DEBUG nova.compute.manager [req-b8286a64-ea73-481e-97fe-c51a52d2d919 req-3f382c34-42c4-4805-9ea0-3a8de1244fcf service nova] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Received event network-vif-deleted-21f1c0e5-0a07-4181-be53-76a32aac14ea {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:21 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:24 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:55:24 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=25.13095474243164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 1e9cae76-2122-436a-868b-bb8c500abfe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 603fa513-0076-4a25-8d93-a6032d551afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance efede298-b109-4259-af3d-beb9cdca7f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 18:55:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [{"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-efede298-b109-4259-af3d-beb9cdca7f6c" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:55:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 18:55:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 18:55:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:55:35 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829720.2512832, 6468fb96-c156-4495-a3f6-927ceb70fac9 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:55:35 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] VM Stopped (Lifecycle Event)
Jul 31 18:55:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-35320500-d74f-464e-be03-7beaf2923231 None None] [instance: 6468fb96-c156-4495-a3f6-927ceb70fac9] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:55:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:42 user nova-compute[72810]: INFO nova.compute.manager [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Terminating instance
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-5f8f7d92-68c5-4c87-8704-c850cb966ad0 req-c700d737-2c01-436b-8ddc-64335924d925 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-unplugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:55:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Instance destroyed successfully.
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid 603fa513-0076-4a25-8d93-a6032d551afd {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-505361169',display_name='tempest-ServerRescueNegativeTestJSON-server-505361169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-505361169',id=5,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-f18xavb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:41:26Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=603fa513-0076-4a25-8d93-a6032d551afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "address": "fa:16:3e:49:ce:43", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35fdd52e-a5", "ovs_interfaceid": "35fdd52e-a504-49c3-aad2-a8ef4e018b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG os_vif [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35fdd52e-a5, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:42 user nova-compute[72810]: INFO os_vif [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ce:43,bridge_name='br-int',has_traffic_filtering=True,id=35fdd52e-a504-49c3-aad2-a8ef4e018b97,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35fdd52e-a5')
Jul 31 18:55:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Deleting instance files /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd_del
Jul 31 18:55:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Deletion of /opt/stack/data/nova/instances/603fa513-0076-4a25-8d93-a6032d551afd_del complete
Jul 31 18:55:43 user nova-compute[72810]: INFO nova.compute.manager [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Took 0.73 seconds to destroy the instance on the hypervisor.
Jul 31 18:55:43 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:43 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Took 0.54 seconds to deallocate network for instance.
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc73a9a8-77bd-4b6f-9eb9-8a67db29c6db req-2daa6c86-e395-41bc-b06f-b58c8a8529f0 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-deleted-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:43 user nova-compute[72810]: INFO nova.compute.manager [req-cc73a9a8-77bd-4b6f-9eb9-8a67db29c6db req-2daa6c86-e395-41bc-b06f-b58c8a8529f0 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Neutron deleted interface 35fdd52e-a504-49c3-aad2-a8ef4e018b97; detaching it from the instance and deleting it from the info cache
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-cc73a9a8-77bd-4b6f-9eb9-8a67db29c6db req-2daa6c86-e395-41bc-b06f-b58c8a8529f0 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-cc73a9a8-77bd-4b6f-9eb9-8a67db29c6db req-2daa6c86-e395-41bc-b06f-b58c8a8529f0 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Detach interface failed, port_id=35fdd52e-a504-49c3-aad2-a8ef4e018b97, reason: Instance 603fa513-0076-4a25-8d93-a6032d551afd could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:55:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:44 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Deleted allocations for instance 603fa513-0076-4a25-8d93-a6032d551afd
Jul 31 18:55:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9582c7de-6b04-4c25-84eb-8eb558ec3019 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "603fa513-0076-4a25-8d93-a6032d551afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.800s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] Acquiring lock "603fa513-0076-4a25-8d93-a6032d551afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] Lock "603fa513-0076-4a25-8d93-a6032d551afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] No waiting events found dispatching network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:44 user nova-compute[72810]: WARNING nova.compute.manager [req-d9bfbbac-3a86-4c73-b56b-ec0792a00ff2 req-a38cb574-1369-4ad6-a48f-7eee53ec1fe1 service nova] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Received unexpected event network-vif-plugged-35fdd52e-a504-49c3-aad2-a8ef4e018b97 for instance with vm_state deleted and task_state None.
Jul 31 18:55:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-changed-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Refreshing instance network info cache due to event network-changed-1ce1b861-fdfd-4e44-a44c-1e921c72c548. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:55:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] Acquiring lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:55:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] Acquired lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:55:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Refreshing network info cache for port 1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:55:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updated VIF entry in instance network info cache for port 1ce1b861-fdfd-4e44-a44c-1e921c72c548. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:55:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating instance_info_cache with network_info: [{"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c295a55c-5665-411b-9af1-ad0817a75ea2 req-73988050-9f32-4522-8308-281ade3c16a6 service nova] Releasing lock "refresh_cache-7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:55:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG nova.objects.instance [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:50 user nova-compute[72810]: INFO nova.compute.manager [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attaching volume ca2de44b-1ec4-490f-b551-7047a61f4348 to /dev/vdb
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.utils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff4e352-c9d8-4474-919b-052f13e7c94e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b082e2-3a8e-4d38-8ef2-03c31372ab50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c33274-197d-4624-bb7c-1c1f1fc4d53f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41de7006-d966-46c9-a3ed-dea4c7f7ded8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:55:50 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:55:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf252989-787e-4c30-8f78-82e2ae61f078]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG os_brick.utils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:55:50 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating existing volume attachment record: 0178ee2e-e6a4-4443-be6b-e3ddeaebaa89 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:55:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:55 user nova-compute[72810]: INFO nova.compute.manager [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Terminating instance
Jul 31 18:55:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-cace927b-5dcf-4e94-a9ef-276750ceb910 req-1ecf53b0-3eaf-4563-a33e-54736161afa3 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-unplugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:55:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Instance destroyed successfully.
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.objects.instance [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lazy-loading 'resources' on Instance uuid efede298-b109-4259-af3d-beb9cdca7f6c {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:48:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1640869050',display_name='tempest-ServerStableDeviceRescueTest-server-1640869050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1640869050',id=26,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjq/9hLgIc/BWvoj3i2M2iVNz9YZ0FWCqbG4fqtwtY0wKc3glxTBL4Kcpisq2xQNjkM33Wav55i/Dwmwocj54DMI42AqFyXOq7+lloEhjjhJNw33RyncuYvha+OlgRzpA==',key_name='tempest-keypair-121170053',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='331edd1d741f45708524dece1d4879c2',ramdisk_id='',reservation_id='r-sb1pgzt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1101694858',owner_user_name='tempest-ServerStableDeviceRescueTest-1101694858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5682f35ef70a4d85ac694eaee676c4f3',uuid=efede298-b109-4259-af3d-beb9cdca7f6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converting VIF {"id": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "address": "fa:16:3e:36:17:be", "network": {"id": "4787aaf0-840d-49a2-9903-00ff5592f61d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1153192523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "331edd1d741f45708524dece1d4879c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49ac8945-2c", "ovs_interfaceid": "49ac8945-2c3b-4732-8c63-e2fbce057f76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG os_vif [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49ac8945-2c, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:55:56 user nova-compute[72810]: INFO os_vif [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:17:be,bridge_name='br-int',has_traffic_filtering=True,id=49ac8945-2c3b-4732-8c63-e2fbce057f76,network=Network(4787aaf0-840d-49a2-9903-00ff5592f61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49ac8945-2c')
Jul 31 18:55:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Deleting instance files /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c_del
Jul 31 18:55:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Deletion of /opt/stack/data/nova/instances/efede298-b109-4259-af3d-beb9cdca7f6c_del complete
Jul 31 18:55:56 user nova-compute[72810]: INFO nova.compute.manager [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 31 18:55:56 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:55:56 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Took 1.10 seconds to deallocate network for instance.
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-2478b05f-99cf-448b-a304-e2883b407d47 req-2816a960-5a0d-4cae-b665-9691c57b4700 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-deleted-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:57 user nova-compute[72810]: INFO nova.compute.manager [req-2478b05f-99cf-448b-a304-e2883b407d47 req-2816a960-5a0d-4cae-b665-9691c57b4700 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Neutron deleted interface 49ac8945-2c3b-4732-8c63-e2fbce057f76; detaching it from the instance and deleting it from the info cache
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-2478b05f-99cf-448b-a304-e2883b407d47 req-2816a960-5a0d-4cae-b665-9691c57b4700 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-2478b05f-99cf-448b-a304-e2883b407d47 req-2816a960-5a0d-4cae-b665-9691c57b4700 service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Detach interface failed, port_id=49ac8945-2c3b-4732-8c63-e2fbce057f76, reason: Instance efede298-b109-4259-af3d-beb9cdca7f6c could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] Acquiring lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] Lock "efede298-b109-4259-af3d-beb9cdca7f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] No waiting events found dispatching network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:57 user nova-compute[72810]: WARNING nova.compute.manager [req-97fcf01e-aa91-4f85-9c12-5ccd98883ec5 req-53a87103-2614-4e58-b4ea-7e49a295f27c service nova] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Received unexpected event network-vif-plugged-49ac8945-2c3b-4732-8c63-e2fbce057f76 for instance with vm_state deleted and task_state None.
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:57 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Deleted allocations for instance efede298-b109-4259-af3d-beb9cdca7f6c
Jul 31 18:55:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-19051c6b-99e6-4234-87b9-fa04add9d0f8 tempest-ServerStableDeviceRescueTest-1101694858 tempest-ServerStableDeviceRescueTest-1101694858-project-member] Lock "efede298-b109-4259-af3d-beb9cdca7f6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.742s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829742.9491534, 603fa513-0076-4a25-8d93-a6032d551afd => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:55:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] VM Stopped (Lifecycle Event)
Jul 31 18:55:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8ae8ee9a-8f56-4987-8d69-9a4198668065 None None] [instance: 603fa513-0076-4a25-8d93-a6032d551afd] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zInSZpqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:55:58 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:55:58 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:55:58 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[acca1e21-2153-4108-960b-35469aac0240]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:55:58 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504c073-d57e-47ca-8cb1-b2b902c3b2ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348] added
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983da3c-ea3a-4534-aa5d-67b5ddf35c9e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea6ce20-ce8d-4721-b067-0739d96c9c9f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zInSZpqH {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zInSZpqH" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fae84f-c49e-4b23-b54b-14b6bcce06d9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zInSZpqH'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4bab67-e190-44a6-bb3c-1f29d16216ac]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e419ab65-2da0-4969-a160-5ddc802132fc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a88c2-684e-4cf6-b3d5-ad17a94c7f93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260]
Jul 31 18:55:58 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260] successful.
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3094ea56-dc3a-47e6-9969-a687d7daaf99]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ef834-a579-40fe-b876-9aecf893973e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:58 user nova-compute[72810]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:55:58 user nova-compute[72810]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)
Jul 31 18:55:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99df54b-d00f-470a-a103-3c76eb0a6eed]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:55:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:59 user nova-compute[72810]: INFO nova.compute.manager [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Terminating instance
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zInSZpqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26238623733373038', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238623733373038', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.objects.instance [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:55:59 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:55:59 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:55:59 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:55:59 user nova-compute[72810]:   <serial>ca2de44b-1ec4-490f-b551-7047a61f4348</serial>
Jul 31 18:55:59 user nova-compute[72810]: </disk>
Jul 31 18:55:59 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:55:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-7bf4e533-9af0-4992-9150-c2876ba901c4 req-6dbd385b-28f5-42f0-acec-ebc2a60f4870 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-unplugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No VIF found with MAC fa:16:3e:dd:61:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-aaf2e333-79c8-42c8-b150-a33a0b82df93 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.017s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Instance destroyed successfully.
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lazy-loading 'resources' on Instance uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2077201862',display_name='tempest-ServerActionsTestOtherA-server-635685006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2077201862',id=1,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3vdUqKURNGgxwrnk2tAb6SJzVsRBNudSwUz/6WDOYd88+0v6pndl9PDoiFhr4MSsAKVEPSJcgj9FmzOwLQV/MIdc74ThpXcOcYC4HzBpO3OSOQRFld6/1egzE9wilINQ==',key_name='tempest-keypair-1713519271',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38248d933d4d42a9aca885b10fbd1afa',ramdisk_id='',reservation_id='r-7axre02d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1074391512',owner_user_name='tempest-ServerActionsTestOtherA-1074391512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a818426c4f424127a01cb9f57e076603',uuid=1e9cae76-2122-436a-868b-bb8c500abfe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converting VIF {"id": "54438c8e-25a3-411a-b897-df13142f4016", "address": "fa:16:3e:03:73:f1", "network": {"id": "07d23794-7b3b-4b2c-afa2-13127b66dca7", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-538678063-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38248d933d4d42a9aca885b10fbd1afa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54438c8e-25", "ovs_interfaceid": "54438c8e-25a3-411a-b897-df13142f4016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG os_vif [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54438c8e-25, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:56:00 user nova-compute[72810]: INFO os_vif [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:73:f1,bridge_name='br-int',has_traffic_filtering=True,id=54438c8e-25a3-411a-b897-df13142f4016,network=Network(07d23794-7b3b-4b2c-afa2-13127b66dca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54438c8e-25')
Jul 31 18:56:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Deleting instance files /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1_del
Jul 31 18:56:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Deletion of /opt/stack/data/nova/instances/1e9cae76-2122-436a-868b-bb8c500abfe1_del complete
Jul 31 18:56:00 user nova-compute[72810]: INFO nova.compute.manager [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:00 user nova-compute[72810]: WARNING nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 1e9cae76-2122-436a-868b-bb8c500abfe1 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid aa8a0c74-8b74-4184-a07a-14cd99b71a37 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 60e683d2-fe34-4191-8c7c-153fe32f5ed0 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d138fb7b-7969-4099-8e54-dfd892738660" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "d138fb7b-7969-4099-8e54-dfd892738660" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:01 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Took 0.56 seconds to deallocate network for instance.
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Deleted allocations for instance 1e9cae76-2122-436a-868b-bb8c500abfe1
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a8052389-c524-4223-9ec4-671a235c8662 tempest-ServerActionsTestOtherA-1074391512 tempest-ServerActionsTestOtherA-1074391512-project-member] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.539s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:01 user nova-compute[72810]: INFO nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] Acquiring lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] Lock "1e9cae76-2122-436a-868b-bb8c500abfe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] No waiting events found dispatching network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:01 user nova-compute[72810]: WARNING nova.compute.manager [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received unexpected event network-vif-plugged-54438c8e-25a3-411a-b897-df13142f4016 for instance with vm_state deleted and task_state None.
Jul 31 18:56:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-817c027d-31c8-4c85-b47f-9b0014a8e3b3 req-68f065c8-38b5-4f0a-9465-637dff45d3f5 service nova] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Received event network-vif-deleted-54438c8e-25a3-411a-b897-df13142f4016 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:11 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829756.047119, efede298-b109-4259-af3d-beb9cdca7f6c => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:11 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] VM Stopped (Lifecycle Event)
Jul 31 18:56:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-11996276-8f76-4a94-a5f7-dbdde6e3e221 None None] [instance: efede298-b109-4259-af3d-beb9cdca7f6c] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:56:12 user nova-compute[72810]: INFO nova.compute.claims [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Claim successful on node user
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 18:56:12 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:56:13 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:56:13 user nova-compute[72810]: INFO nova.virt.block_device [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Booting with volume-backed-image 0efe86ed-5b8c-473b-b5ee-c879a1eae6b6 at /dev/vda
Jul 31 18:56:13 user nova-compute[72810]: DEBUG nova.policy [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef3882653e7244108f590048754d86b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb86a791f5464179b055746ede494239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:56:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Successfully created port: 59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Successfully updated port: 59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-changed-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Refreshing instance network info cache due to event network-changed-59b8eb7f-c76e-4d61-a35e-cace57809ddb. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] Acquiring lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829760.3573773, 1e9cae76-2122-436a-868b-bb8c500abfe1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:15 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] VM Stopped (Lifecycle Event)
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8467e5fa-47ac-43bc-9bb9-c48b1f739b40 None None] [instance: 1e9cae76-2122-436a-868b-bb8c500abfe1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance network_info: |[{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] Acquired lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Refreshing network info cache for port 59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updated VIF entry in instance network info cache for port 59b8eb7f-c76e-4d61-a35e-cace57809ddb. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG nova.network.neutron [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0a766547-e8bc-4cd8-b98d-c0e1c2b8eab4 req-fff6754a-2f35-42f4-9abe-ccadf630058e service nova] Releasing lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:56:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:56:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.utils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[674ad7f8-597e-4d65-8fe2-660a1f67d254]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49e2e5c-65b8-484b-8d60-f8173c93b363]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[049cec5a-33a3-47f5-87af-68eff0492bf7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[861922a6-19b1-4b56-a816-7740b22d8376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:56:24 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e522a87e-28a5-4e31-8349-94aad1acbf3c]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG os_brick.utils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating existing volume attachment record: 224644b8-05c4-410a-bf8c-75339aa49f93 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:24 user nova-compute[72810]: INFO nova.compute.manager [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Detaching volume ca2de44b-1ec4-490f-b551-7047a61f4348
Jul 31 18:56:25 user nova-compute[72810]: INFO nova.virt.block_device [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attempting to driver detach volume ca2de44b-1ec4-490f-b551-7047a61f4348 from mountpoint /dev/vdb
Jul 31 18:56:25 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:25 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8017MB free_disk=25.290985107421875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Attempting to detach device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:56:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:56:25 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:56:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:56:25 user nova-compute[72810]:   <serial>ca2de44b-1ec4-490f-b551-7047a61f4348</serial>
Jul 31 18:56:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:56:25 user nova-compute[72810]: </disk>
Jul 31 18:56:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:56:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config.
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:56:25 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:56:25 user nova-compute[72810]:   <source dev="/dev/sdc"/>
Jul 31 18:56:25 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:56:25 user nova-compute[72810]:   <serial>ca2de44b-1ec4-490f-b551-7047a61f4348</serial>
Jul 31 18:56:25 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:56:25 user nova-compute[72810]: </disk>
Jul 31 18:56:25 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d138fb7b-7969-4099-8e54-dfd892738660 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829785.918485, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:56:25 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config.
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zInSZpqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:56:25 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c9b06-17d4-46b6-9eb9-54198ab473a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3603195-4174-49d9-a43c-294adc61ee7a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:25 user nova-compute[72810]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)
Jul 31 18:56:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:56:25 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:25 user nova-compute[72810]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 (non-flash)
Jul 31 18:56:25 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec0fc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[72655aeb-b17b-488a-9129-45b723ca4494]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d9b67-2318-435d-b46d-d24a617e9c4b]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e45d0c-761a-46db-9d91-84f16a6f2c23]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbddae3d-4ecc-4e33-898d-26cf1394b681]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd054588-8f4e-4f6c-b1c1-9666e2c5f4d4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89167414-8d60-4659-af54-86bb08f41ef4]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260]
Jul 31 18:56:26 user nova-compute[72810]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348, portal: 172.16.0.220,3260] successful.
Jul 31 18:56:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca2de44b-1ec4-490f-b551-7047a61f4348 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4b9c0-27e8-4cb7-a506-8e2835ee70e3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== disconnect_volume: return (284ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:56:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:56:27 user nova-compute[72810]: DEBUG nova.objects.instance [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af835d50-a933-42d7-af5b-01201b9745bd tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.435s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:56:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Creating image(s)
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Ensure instance console log exists: /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start _get_guest_xml network_info=[{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d91e596-3d85-41e7-961a-bf9105555be1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cda4ec83-9413-4ebe-b61e-16029089dff5', 'serial': 'cda4ec83-9413-4ebe-b61e-16029089dff5'}, 'attachment_id': '224644b8-05c4-410a-bf8c-75339aa49f93', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:56:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:56:32 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:56:32 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:56:32 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:56:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda80b20-614c-4afd-a08d-e80ccb37bbf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:56:32 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7e4ba-08ef-466f-b7ab-464a9f73c5ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5] added
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61cb512-2e4f-4bda-8499-05d797561f7d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217e7c5-9484-4960-a580-d0cef27556bc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnyFdhzM {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnyFdhzM" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[655b4e10-6ff5-49e7-a739-79a9b123cc83]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnyFdhzM'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7495232-99ac-4706-bf50-c7a2077f19c5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b81e94-a3ec-4364-91a6-18aa87d3cf6a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf5fd88-7ece-4f4d-b1ef-4798c248b6e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260]
Jul 31 18:56:32 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260] successful.
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a765b06f-be43-4f62-8756-46c3dad196ed]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc8156f-8ccf-4111-b307-40847cb118e6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:32 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:56:32 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:56:32 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f2d5a-3b47-4ac8-a0e3-16627650cb67]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:32 user nova-compute[72810]: INFO nova.compute.manager [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Terminating instance
Jul 31 18:56:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-a667b0ea-2013-44ec-84ec-4d8040793d67 req-ef67501a-c9c4-46c2-8c2e-18cbb9b493b8 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-unplugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Instance destroyed successfully.
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lazy-loading 'resources' on Instance uuid d138fb7b-7969-4099-8e54-dfd892738660 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2023309342',display_name='tempest-ServerRescueNegativeTestJSON-server-2023309342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2023309342',id=3,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc3897e37c484827819b5d56cee9345a',ramdisk_id='',reservation_id='r-dzqw94br',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1295429689',owner_user_name='tempest-ServerRescueNegativeTestJSON-1295429689-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:46:10Z,user_data=None,user_id='cf8b9f2a471b40b7ba541f9da121207a',uuid=d138fb7b-7969-4099-8e54-dfd892738660,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converting VIF {"id": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "address": "fa:16:3e:2a:f7:ad", "network": {"id": "70f5672d-ec9a-4016-b2aa-a4e722e89ba0", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1045961947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc3897e37c484827819b5d56cee9345a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd26e6cf1-fb", "ovs_interfaceid": "d26e6cf1-fb0d-4592-bd29-d26190c47b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG os_vif [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd26e6cf1-fb, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:56:33 user nova-compute[72810]: INFO os_vif [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f7:ad,bridge_name='br-int',has_traffic_filtering=True,id=d26e6cf1-fb0d-4592-bd29-d26190c47b99,network=Network(70f5672d-ec9a-4016-b2aa-a4e722e89ba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd26e6cf1-fb')
Jul 31 18:56:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Deleting instance files /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660_del
Jul 31 18:56:33 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Deletion of /opt/stack/data/nova/instances/d138fb7b-7969-4099-8e54-dfd892738660_del complete
Jul 31 18:56:33 user nova-compute[72810]: INFO nova.compute.manager [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 31 18:56:33 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23639316139623262', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639316139623262', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-842845383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-842845383',id=35,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-2eloz3fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:56:13Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=8d91e596-3d85-41e7-961a-bf9105555be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:56:33 user nova-compute[72810]:   <uuid>8d91e596-3d85-41e7-961a-bf9105555be1</uuid>
Jul 31 18:56:33 user nova-compute[72810]:   <name>instance-00000023</name>
Jul 31 18:56:33 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:56:33 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:56:33 user nova-compute[72810]:   <metadata>
Jul 31 18:56:33 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:56:33 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-842845383</nova:name>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:56:32</nova:creationTime>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:56:33 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:56:33 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:owner>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:56:33 user nova-compute[72810]:       </nova:owner>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:56:33 user nova-compute[72810]:       <nova:ports>
Jul 31 18:56:33 user nova-compute[72810]:         <nova:port uuid="59b8eb7f-c76e-4d61-a35e-cace57809ddb">
Jul 31 18:56:33 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:56:33 user nova-compute[72810]:         </nova:port>
Jul 31 18:56:33 user nova-compute[72810]:       </nova:ports>
Jul 31 18:56:33 user nova-compute[72810]:     </nova:instance>
Jul 31 18:56:33 user nova-compute[72810]:   </metadata>
Jul 31 18:56:33 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:56:33 user nova-compute[72810]:     <system>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="serial">8d91e596-3d85-41e7-961a-bf9105555be1</entry>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="uuid">8d91e596-3d85-41e7-961a-bf9105555be1</entry>
Jul 31 18:56:33 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:56:33 user nova-compute[72810]:     </system>
Jul 31 18:56:33 user nova-compute[72810]:   </sysinfo>
Jul 31 18:56:33 user nova-compute[72810]:   <os>
Jul 31 18:56:33 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:56:33 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:56:33 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:56:33 user nova-compute[72810]:   </os>
Jul 31 18:56:33 user nova-compute[72810]:   <features>
Jul 31 18:56:33 user nova-compute[72810]:     <acpi/>
Jul 31 18:56:33 user nova-compute[72810]:     <apic/>
Jul 31 18:56:33 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:56:33 user nova-compute[72810]:   </features>
Jul 31 18:56:33 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:56:33 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:56:33 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:56:33 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:56:33 user nova-compute[72810]:   </clock>
Jul 31 18:56:33 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:56:33 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:56:33 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:56:33 user nova-compute[72810]:   </cpu>
Jul 31 18:56:33 user nova-compute[72810]:   <devices>
Jul 31 18:56:33 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:56:33 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:56:33 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:56:33 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:56:33 user nova-compute[72810]:       <serial>cda4ec83-9413-4ebe-b61e-16029089dff5</serial>
Jul 31 18:56:33 user nova-compute[72810]:     </disk>
Jul 31 18:56:33 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:56:33 user nova-compute[72810]:       <mac address="fa:16:3e:7c:ba:40"/>
Jul 31 18:56:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:56:33 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:56:33 user nova-compute[72810]:       <target dev="tap59b8eb7f-c7"/>
Jul 31 18:56:33 user nova-compute[72810]:     </interface>
Jul 31 18:56:33 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:56:33 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/console.log" append="off"/>
Jul 31 18:56:33 user nova-compute[72810]:     </serial>
Jul 31 18:56:33 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:56:33 user nova-compute[72810]:     <video>
Jul 31 18:56:33 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:56:33 user nova-compute[72810]:     </video>
Jul 31 18:56:33 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:56:33 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:56:33 user nova-compute[72810]:     </rng>
Jul 31 18:56:33 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:56:33 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:56:33 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:56:33 user nova-compute[72810]:     </memballoon>
Jul 31 18:56:33 user nova-compute[72810]:   </devices>
Jul 31 18:56:33 user nova-compute[72810]: </domain>
Jul 31 18:56:33 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-842845383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-842845383',id=35,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-2eloz3fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:56:13Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=8d91e596-3d85-41e7-961a-bf9105555be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG os_vif [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59b8eb7f-c7, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59b8eb7f-c7, col_values=(('external_ids', {'iface-id': '59b8eb7f-c76e-4d61-a35e-cace57809ddb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:ba:40', 'vm-uuid': '8d91e596-3d85-41e7-961a-bf9105555be1'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:33 user nova-compute[72810]: INFO os_vif [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7')
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:56:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:7c:ba:40, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:34 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Took 0.80 seconds to deallocate network for instance.
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-43249c8b-ecb7-4967-9e8f-8bc0e04926cd req-9ecd0b57-622c-401c-bc50-1e5174c7cf24 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-deleted-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:34 user nova-compute[72810]: INFO nova.compute.manager [req-43249c8b-ecb7-4967-9e8f-8bc0e04926cd req-9ecd0b57-622c-401c-bc50-1e5174c7cf24 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Neutron deleted interface d26e6cf1-fb0d-4592-bd29-d26190c47b99; detaching it from the instance and deleting it from the info cache
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-43249c8b-ecb7-4967-9e8f-8bc0e04926cd req-9ecd0b57-622c-401c-bc50-1e5174c7cf24 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.compute.manager [req-43249c8b-ecb7-4967-9e8f-8bc0e04926cd req-9ecd0b57-622c-401c-bc50-1e5174c7cf24 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Detach interface failed, port_id=d26e6cf1-fb0d-4592-bd29-d26190c47b99, reason: Instance d138fb7b-7969-4099-8e54-dfd892738660 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:56:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:34 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Deleted allocations for instance d138fb7b-7969-4099-8e54-dfd892738660
Jul 31 18:56:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-178a2a71-005c-4f5e-8b96-373c140a88a8 tempest-ServerRescueNegativeTestJSON-1295429689 tempest-ServerRescueNegativeTestJSON-1295429689-project-member] Lock "d138fb7b-7969-4099-8e54-dfd892738660" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.047s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] Acquiring lock "d138fb7b-7969-4099-8e54-dfd892738660-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] Lock "d138fb7b-7969-4099-8e54-dfd892738660-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] No waiting events found dispatching network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:35 user nova-compute[72810]: WARNING nova.compute.manager [req-6b0120a2-6f90-4c86-a240-26daec7ad699 req-eac3a23e-07c8-4e8d-a74d-6f7f30211c30 service nova] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Received unexpected event network-vif-plugged-d26e6cf1-fb0d-4592-bd29-d26190c47b99 for instance with vm_state deleted and task_state None.
Jul 31 18:56:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:36 user nova-compute[72810]: WARNING nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state building and task_state spawning.
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:36 user nova-compute[72810]: WARNING nova.compute.manager [req-d4b94503-ae9b-4f98-8ff0-099871aafb3c req-45e0339a-982d-486e-ad85-0ae11f36c429 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state building and task_state spawning.
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:56:36 user nova-compute[72810]: INFO nova.compute.claims [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Claim successful on node user
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.policy [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f32a4a39bdc641929203ee3949cf1245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d5188096584e56ba95e5c5af731aae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829797.5337305, 8d91e596-3d85-41e7-961a-bf9105555be1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Resumed (Lifecycle Event)
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance spawned successfully.
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Creating image(s)
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "/opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "/opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "/opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Took 5.20 seconds to spawn the instance on the hypervisor.
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829797.5348537, 8d91e596-3d85-41e7-961a-bf9105555be1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Started (Lifecycle Event)
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:56:37 user nova-compute[72810]: INFO nova.compute.manager [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Took 25.16 seconds to build instance.
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3c5000bd-07fa-47a4-a156-97ad17620108 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.309s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk 1073741824" returned: 0 in 0.050s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Successfully created port: bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Cannot resize image /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'migration_context' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Ensure instance console log exists: /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Successfully updated port: bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquired lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-changed-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Refreshing instance network info cache due to event network-changed-bb6de756-f05b-4d3a-8e62-fb36db4fd89b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] Acquiring lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating instance_info_cache with network_info: [{"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Releasing lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Instance network_info: |[{"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] Acquired lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Refreshing network info cache for port bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Start _get_guest_xml network_info=[{"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:56:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1142056251',display_name='tempest-TestServerVolumeAttachmentScenario-server-1142056251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1142056251',id=36,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMa1JDq/yDU6uu58oPfH3zlIlrLOvKEs2p9v9FOyA9oRZsFNxcpi3XZBGE7Z+6R6+/n2Mla/71ttCKcJUBc1Wo7QOo35i05hZqQa9TymHtwzLNHzaJNni76HyehV2oy1g==',key_name='tempest-keypair-1144872895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3d5188096584e56ba95e5c5af731aae',ramdisk_id='',reservation_id='r-gqyltc0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-845793169',owner_user_name='tempest-TestServerVolumeAttachmentScenario-845793169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32a4a39bdc641929203ee3949cf1245',uuid=36d5fe03-adf6-4c49-a691-435a0f282972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converting VIF {"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'pci_devices' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:56:39 user nova-compute[72810]:   <uuid>36d5fe03-adf6-4c49-a691-435a0f282972</uuid>
Jul 31 18:56:39 user nova-compute[72810]:   <name>instance-00000024</name>
Jul 31 18:56:39 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:56:39 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:56:39 user nova-compute[72810]:   <metadata>
Jul 31 18:56:39 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:56:39 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1142056251</nova:name>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:56:39</nova:creationTime>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:56:39 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:56:39 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:owner>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:user uuid="f32a4a39bdc641929203ee3949cf1245">tempest-TestServerVolumeAttachmentScenario-845793169-project-member</nova:user>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:project uuid="c3d5188096584e56ba95e5c5af731aae">tempest-TestServerVolumeAttachmentScenario-845793169</nova:project>
Jul 31 18:56:39 user nova-compute[72810]:       </nova:owner>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:56:39 user nova-compute[72810]:       <nova:ports>
Jul 31 18:56:39 user nova-compute[72810]:         <nova:port uuid="bb6de756-f05b-4d3a-8e62-fb36db4fd89b">
Jul 31 18:56:39 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 18:56:39 user nova-compute[72810]:         </nova:port>
Jul 31 18:56:39 user nova-compute[72810]:       </nova:ports>
Jul 31 18:56:39 user nova-compute[72810]:     </nova:instance>
Jul 31 18:56:39 user nova-compute[72810]:   </metadata>
Jul 31 18:56:39 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:56:39 user nova-compute[72810]:     <system>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="serial">36d5fe03-adf6-4c49-a691-435a0f282972</entry>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="uuid">36d5fe03-adf6-4c49-a691-435a0f282972</entry>
Jul 31 18:56:39 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:56:39 user nova-compute[72810]:     </system>
Jul 31 18:56:39 user nova-compute[72810]:   </sysinfo>
Jul 31 18:56:39 user nova-compute[72810]:   <os>
Jul 31 18:56:39 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:56:39 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:56:39 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:56:39 user nova-compute[72810]:   </os>
Jul 31 18:56:39 user nova-compute[72810]:   <features>
Jul 31 18:56:39 user nova-compute[72810]:     <acpi/>
Jul 31 18:56:39 user nova-compute[72810]:     <apic/>
Jul 31 18:56:39 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:56:39 user nova-compute[72810]:   </features>
Jul 31 18:56:39 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:56:39 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:56:39 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:56:39 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:56:39 user nova-compute[72810]:   </clock>
Jul 31 18:56:39 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:56:39 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:56:39 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:56:39 user nova-compute[72810]:   </cpu>
Jul 31 18:56:39 user nova-compute[72810]:   <devices>
Jul 31 18:56:39 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:56:39 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:56:39 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk"/>
Jul 31 18:56:39 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:56:39 user nova-compute[72810]:     </disk>
Jul 31 18:56:39 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:56:39 user nova-compute[72810]:       <mac address="fa:16:3e:c9:0d:4a"/>
Jul 31 18:56:39 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:56:39 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:56:39 user nova-compute[72810]:       <target dev="tapbb6de756-f0"/>
Jul 31 18:56:39 user nova-compute[72810]:     </interface>
Jul 31 18:56:39 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:56:39 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/console.log" append="off"/>
Jul 31 18:56:39 user nova-compute[72810]:     </serial>
Jul 31 18:56:39 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:56:39 user nova-compute[72810]:     <video>
Jul 31 18:56:39 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:56:39 user nova-compute[72810]:     </video>
Jul 31 18:56:39 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:56:39 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:56:39 user nova-compute[72810]:     </rng>
Jul 31 18:56:39 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:56:39 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:56:39 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:56:39 user nova-compute[72810]:     </memballoon>
Jul 31 18:56:39 user nova-compute[72810]:   </devices>
Jul 31 18:56:39 user nova-compute[72810]: </domain>
Jul 31 18:56:39 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1142056251',display_name='tempest-TestServerVolumeAttachmentScenario-server-1142056251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1142056251',id=36,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMa1JDq/yDU6uu58oPfH3zlIlrLOvKEs2p9v9FOyA9oRZsFNxcpi3XZBGE7Z+6R6+/n2Mla/71ttCKcJUBc1Wo7QOo35i05hZqQa9TymHtwzLNHzaJNni76HyehV2oy1g==',key_name='tempest-keypair-1144872895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3d5188096584e56ba95e5c5af731aae',ramdisk_id='',reservation_id='r-gqyltc0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-845793169',owner_user_name='tempest-TestServerVolumeAttachmentScenario-845793169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32a4a39bdc641929203ee3949cf1245',uuid=36d5fe03-adf6-4c49-a691-435a0f282972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converting VIF {"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG os_vif [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb6de756-f0, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb6de756-f0, col_values=(('external_ids', {'iface-id': 'bb6de756-f05b-4d3a-8e62-fb36db4fd89b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:0d:4a', 'vm-uuid': '36d5fe03-adf6-4c49-a691-435a0f282972'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:39 user nova-compute[72810]: INFO os_vif [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0')
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No VIF found with MAC fa:16:3e:c9:0d:4a, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updated VIF entry in instance network info cache for port bb6de756-f05b-4d3a-8e62-fb36db4fd89b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:56:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating instance_info_cache with network_info: [{"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:56:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3af667ff-a530-4ab9-9c81-32304d1fefee req-2d86b58a-fc47-498b-8a0a-5db2d9efc322 service nova] Releasing lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] No waiting events found dispatching network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:41 user nova-compute[72810]: WARNING nova.compute.manager [req-4978fe0b-1926-4ea4-b18c-f99a10032805 req-a5a2ba26-7429-4ec3-85f0-96eda31469a4 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received unexpected event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b for instance with vm_state building and task_state spawning.
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829803.447982, 36d5fe03-adf6-4c49-a691-435a0f282972 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] VM Resumed (Lifecycle Event)
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Instance spawned successfully.
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829803.448815, 36d5fe03-adf6-4c49-a691-435a0f282972 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] VM Started (Lifecycle Event)
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] No waiting events found dispatching network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:56:43 user nova-compute[72810]: WARNING nova.compute.manager [req-9322cb7e-d172-4d15-a052-50cc1814d00f req-408b2954-3f5b-40e7-a077-22d6e4cf7a6b service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received unexpected event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b for instance with vm_state building and task_state spawning.
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Took 5.99 seconds to spawn the instance on the hypervisor.
Jul 31 18:56:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:56:43 user nova-compute[72810]: INFO nova.compute.manager [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Took 6.76 seconds to build instance.
Jul 31 18:56:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-92d39b62-bb98-4800-ada4-9db069d4a92e tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.856s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:56:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:48 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829793.4666946, d138fb7b-7969-4099-8e54-dfd892738660 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:56:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d138fb7b-7969-4099-8e54-dfd892738660] VM Stopped (Lifecycle Event)
Jul 31 18:56:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-78a77f19-72a3-4c68-91ec-8f007c65ea69 None None] [instance: d138fb7b-7969-4099-8e54-dfd892738660] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:56:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:56:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:57:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:22 user nova-compute[72810]: INFO nova.compute.manager [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attaching volume e64ffe87-e421-4183-81b1-80f8068469e3 to /dev/vdb
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.utils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e836646c-fcc9-48c8-b564-3e77d790cf12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e317b26c-4c04-4288-88ec-48c0e7e7730a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b926832-18a5-4e73-9348-021a9a7a794e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e629b64-0637-4ea1-9bde-8626ee10763a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:57:22 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:57:22 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a454d-b6d1-4f28-9f4d-24244a2928ec]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG os_brick.utils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:57:22 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating existing volume attachment record: 8508efc4-1fb7-4549-bd69-b3414f85ac69 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:23 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:57:24 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:25 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:26 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:57:26 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7877MB free_disk=25.26866912841797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 36d5fe03-adf6-4c49-a691-435a0f282972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:57:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:57:29 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHAxJspz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:57:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:57:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:57:30 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9771715c-0e03-4728-a99e-4a70d20ff8a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:57:30 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b66be5a-7061-44a1-bb1e-b04c0c0a5f8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3] added
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c8a6a-19a4-435b-a2f8-da9a56f6d343]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5364002-d3cc-4afb-bade-465bfbc564b7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHAxJspz {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHAxJspz" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf000413-3a1a-4cd5-8ea0-e6b254aefc91]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHAxJspz'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfe913-8849-409d-9189-36a76732efe9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e6d05-408c-4550-8177-d492199af859]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4184e7d-32ca-4cf7-9ec0-8303b01aedd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260]
Jul 31 18:57:30 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260] successful.
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63954f3-8ceb-492c-b30b-51bc2fa2b891]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff374f4-b730-4f85-b8f0-83ca39113906]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)
Jul 31 18:57:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5247204-4749-47b2-ba35-bbf35f438c5e]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:57:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHAxJspz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23962393762633164', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962393762633164', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG nova.objects.instance [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:57:31 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:57:31 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:57:31 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:57:31 user nova-compute[72810]:   <serial>e64ffe87-e421-4183-81b1-80f8068469e3</serial>
Jul 31 18:57:31 user nova-compute[72810]: </disk>
Jul 31 18:57:31 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:57:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:57:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:57:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No VIF found with MAC fa:16:3e:dd:61:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:57:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-fd63fbd7-14b2-4edf-9daf-916510c2507b tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.247s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:34 user nova-compute[72810]: INFO nova.compute.manager [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Detaching volume e64ffe87-e421-4183-81b1-80f8068469e3
Jul 31 18:57:35 user nova-compute[72810]: INFO nova.virt.block_device [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attempting to driver detach volume e64ffe87-e421-4183-81b1-80f8068469e3 from mountpoint /dev/vdb
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Attempting to detach device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:57:35 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:57:35 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:57:35 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:57:35 user nova-compute[72810]:   <serial>e64ffe87-e421-4183-81b1-80f8068469e3</serial>
Jul 31 18:57:35 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:57:35 user nova-compute[72810]: </disk>
Jul 31 18:57:35 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:57:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config.
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:57:35 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:57:35 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:57:35 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:57:35 user nova-compute[72810]:   <serial>e64ffe87-e421-4183-81b1-80f8068469e3</serial>
Jul 31 18:57:35 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:57:35 user nova-compute[72810]: </disk>
Jul 31 18:57:35 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829855.5309768, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:57:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config.
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHAxJspz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:57:35 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5535ec-9996-47b8-9b4c-7f5023a33750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ad51e7-af2e-4741-8988-e405cdef9f29]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:35 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:35 user nova-compute[72810]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)
Jul 31 18:57:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:57:35 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:57:35 user nova-compute[72810]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 (non-flash)
Jul 31 18:57:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec1181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f4d93b-a379-4c81-87c6-67c6dc199e66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5df1ec-1ede-4ae1-8dd9-c4b59f424318]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61e4e1-39e5-4aa5-8cd3-a08b723e4af1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[889147ea-3f71-4eb7-8b41-37f89e487f96]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7488f6b-fffc-4fe3-b2cd-5852f11ca558]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd743f4-9bb8-4024-a275-7e3dd89b76a5]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260]
Jul 31 18:57:35 user nova-compute[72810]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3, portal: 172.16.0.220,3260] successful.
Jul 31 18:57:35 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e64ffe87-e421-4183-81b1-80f8068469e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2274a8-d037-46ce-ae3d-91a784c33792]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== disconnect_volume: return (343ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:57:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:57:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a584fee8-c2f0-4144-bd0e-7016c96fb5af tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 18:57:39 user nova-compute[72810]: INFO nova.compute.claims [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Claim successful on node user
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 18:57:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.policy [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145454abe36e4eb990a0431c1bcebc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e7dddc0de04feb9cc40460f2f5fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 18:57:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Creating image(s)
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk 1073741824" returned: 0 in 0.054s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Successfully created port: cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Cannot resize image /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.objects.instance [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'migration_context' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Ensure instance console log exists: /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Successfully updated port: cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing instance network info cache due to event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:57:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance network_info: |[{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.neutron [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start _get_guest_xml network_info=[{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:57:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:57:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPefv6bMov76QfWm4jIXUtqGj2kNw9CQutsTRR/ZCka+5tC34J6MTEcrmXgBdbECqxMwjz4tcBozwKvnnl4tNpJBpECiHuGPl8+INoH6J1+Fb/r/lEtBdgcHbRVkV7aQtA==',key_name='tempest-keypair-1934194688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_devices' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:57:42 user nova-compute[72810]:   <uuid>d5566068-a0b7-4c77-a73a-e30ce589fa4a</uuid>
Jul 31 18:57:42 user nova-compute[72810]:   <name>instance-00000025</name>
Jul 31 18:57:42 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:57:42 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:57:42 user nova-compute[72810]:   <metadata>
Jul 31 18:57:42 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:57:42 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1911600020</nova:name>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:57:42</nova:creationTime>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:57:42 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:57:42 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:owner>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:user uuid="145454abe36e4eb990a0431c1bcebc43">tempest-AttachVolumeShelveTestJSON-1432800121-project-member</nova:user>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:project uuid="b7e7dddc0de04feb9cc40460f2f5fe68">tempest-AttachVolumeShelveTestJSON-1432800121</nova:project>
Jul 31 18:57:42 user nova-compute[72810]:       </nova:owner>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:57:42 user nova-compute[72810]:       <nova:ports>
Jul 31 18:57:42 user nova-compute[72810]:         <nova:port uuid="cac99b5c-b78f-499d-8a23-d73c76d3729f">
Jul 31 18:57:42 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:57:42 user nova-compute[72810]:         </nova:port>
Jul 31 18:57:42 user nova-compute[72810]:       </nova:ports>
Jul 31 18:57:42 user nova-compute[72810]:     </nova:instance>
Jul 31 18:57:42 user nova-compute[72810]:   </metadata>
Jul 31 18:57:42 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:57:42 user nova-compute[72810]:     <system>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="serial">d5566068-a0b7-4c77-a73a-e30ce589fa4a</entry>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="uuid">d5566068-a0b7-4c77-a73a-e30ce589fa4a</entry>
Jul 31 18:57:42 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:57:42 user nova-compute[72810]:     </system>
Jul 31 18:57:42 user nova-compute[72810]:   </sysinfo>
Jul 31 18:57:42 user nova-compute[72810]:   <os>
Jul 31 18:57:42 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:57:42 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 18:57:42 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:57:42 user nova-compute[72810]:   </os>
Jul 31 18:57:42 user nova-compute[72810]:   <features>
Jul 31 18:57:42 user nova-compute[72810]:     <acpi/>
Jul 31 18:57:42 user nova-compute[72810]:     <apic/>
Jul 31 18:57:42 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:57:42 user nova-compute[72810]:   </features>
Jul 31 18:57:42 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:57:42 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:57:42 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:57:42 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:57:42 user nova-compute[72810]:   </clock>
Jul 31 18:57:42 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:57:42 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:57:42 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:57:42 user nova-compute[72810]:   </cpu>
Jul 31 18:57:42 user nova-compute[72810]:   <devices>
Jul 31 18:57:42 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:57:42 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:57:42 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk"/>
Jul 31 18:57:42 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:57:42 user nova-compute[72810]:     </disk>
Jul 31 18:57:42 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:57:42 user nova-compute[72810]:       <mac address="fa:16:3e:a3:b7:f8"/>
Jul 31 18:57:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:57:42 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:57:42 user nova-compute[72810]:       <target dev="tapcac99b5c-b7"/>
Jul 31 18:57:42 user nova-compute[72810]:     </interface>
Jul 31 18:57:42 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:57:42 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/console.log" append="off"/>
Jul 31 18:57:42 user nova-compute[72810]:     </serial>
Jul 31 18:57:42 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:57:42 user nova-compute[72810]:     <video>
Jul 31 18:57:42 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:57:42 user nova-compute[72810]:     </video>
Jul 31 18:57:42 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:57:42 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:57:42 user nova-compute[72810]:     </rng>
Jul 31 18:57:42 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:57:42 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:57:42 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:57:42 user nova-compute[72810]:     </memballoon>
Jul 31 18:57:42 user nova-compute[72810]:   </devices>
Jul 31 18:57:42 user nova-compute[72810]: </domain>
Jul 31 18:57:42 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPefv6bMov76QfWm4jIXUtqGj2kNw9CQutsTRR/ZCka+5tC34J6MTEcrmXgBdbECqxMwjz4tcBozwKvnnl4tNpJBpECiHuGPl8+INoH6J1+Fb/r/lEtBdgcHbRVkV7aQtA==',key_name='tempest-keypair-1934194688',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG os_vif [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcac99b5c-b7, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcac99b5c-b7, col_values=(('external_ids', {'iface-id': 'cac99b5c-b78f-499d-8a23-d73c76d3729f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b7:f8', 'vm-uuid': 'd5566068-a0b7-4c77-a73a-e30ce589fa4a'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:42 user nova-compute[72810]: INFO os_vif [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7')
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:57:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No VIF found with MAC fa:16:3e:a3:b7:f8, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updated VIF entry in instance network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG nova.network.neutron [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-03ddd7f2-1900-4a4d-a3b9-66bccd315c7a req-31151ced-7c32-44c2-a18b-c94705b80ded service nova] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:57:44 user nova-compute[72810]: WARNING nova.compute.manager [req-9d5599d5-0c74-4e8c-9f13-68edc9cf981f req-80030149-ad6b-4c88-9110-ff5ea04a3b91 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state building and task_state spawning.
Jul 31 18:57:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829865.9034083, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:57:45 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Resumed (Lifecycle Event)
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 18:57:45 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance spawned successfully.
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 18:57:45 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829865.9081347, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:57:45 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Started (Lifecycle Event)
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:57:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:57:46 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 18:57:46 user nova-compute[72810]: INFO nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Took 5.53 seconds to spawn the instance on the hypervisor.
Jul 31 18:57:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:57:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:57:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:57:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:57:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:57:46 user nova-compute[72810]: WARNING nova.compute.manager [req-298241c1-22d8-4fc2-964c-898322ad81a6 req-cf7cab37-005b-47f1-a498-911e958f6b53 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state building and task_state spawning.
Jul 31 18:57:46 user nova-compute[72810]: INFO nova.compute.manager [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Took 6.24 seconds to build instance.
Jul 31 18:57:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-f2afc4aa-e2a1-473e-8e2a-5d16f31b68dc tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:57:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:57:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:02 user nova-compute[72810]: INFO nova.compute.manager [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Rescuing
Jul 31 18:58:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:58:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:58:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:58:03 user nova-compute[72810]: WARNING nova.compute.manager [req-cf118e98-4d70-4ae0-812e-c7e697742480 req-d559eabc-1380-484f-a5ce-2a5ce5b4a4b5 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state active and task_state rescuing.
Jul 31 18:58:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance destroyed successfully.
Jul 31 18:58:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Attempting a stable device rescue
Jul 31 18:58:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72810) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance directory exists: not creating {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 18:58:04 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Creating image(s)
Jul 31 18:58:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG nova.virt.images [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] c4a1491f-20fe-433d-8d58-28a2e775ed80 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.part /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:58:05 user nova-compute[72810]: WARNING nova.compute.manager [req-e5d30be4-1d3d-4917-b221-328fba4c895a req-ef195566-b979-48b8-ad57-2d65d5f3c577 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state active and task_state rescuing.
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.part /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.converted" returned: 0 in 0.594s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.160s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3 --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3,backing_fmt=raw /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3,backing_fmt=raw /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue" returned: 0 in 0.059s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'migration_context' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start _get_guest_xml network_info=[{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:7c:ba:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c4a1491f-20fe-433d-8d58-28a2e775ed80', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8d91e596-3d85-41e7-961a-bf9105555be1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cda4ec83-9413-4ebe-b61e-16029089dff5', 'serial': 'cda4ec83-9413-4ebe-b61e-16029089dff5'}, 'attachment_id': '224644b8-05c4-410a-bf8c-75339aa49f93', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:06 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:58:06 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:06 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4e27c-d671-4459-97b1-ef1a471022c1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rnyFdhzM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 18:58:06 user nova-compute[72810]: node.name = iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5
Jul 31 18:58:06 user nova-compute[72810]: node.tpgt = -1
Jul 31 18:58:06 user nova-compute[72810]: node.startup = automatic
Jul 31 18:58:06 user nova-compute[72810]: node.leading_login = No
Jul 31 18:58:06 user nova-compute[72810]: iface.iscsi_ifacename = default
Jul 31 18:58:06 user nova-compute[72810]: iface.net_ifacename = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.ipaddress = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.prefix_len = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.hwaddress = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.transport_name = tcp
Jul 31 18:58:06 user nova-compute[72810]: iface.initiatorname = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.vlan_id = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.vlan_priority = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.vlan_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.iface_num = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.mtu = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.port = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.bootproto = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.subnet_mask = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.gateway = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_alt_client_id = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_dns = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_learn_iqn = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_vendor_id_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_vendor_id = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.dhcp_slp_da = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.fragmentation = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.gratuitous_arp = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.incoming_forwarding = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.tos_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.tos = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.ttl = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.delayed_ack = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.tcp_nagle = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.tcp_wsf_state = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.tcp_wsf = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.tcp_timer_scale = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.tcp_timestamp = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.redirect = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.def_task_mgmt_timeout = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.header_digest = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.data_digest = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.immediate_data = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.initial_r2t = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.data_seq_inorder = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.data_pdu_inorder = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.erl = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.max_receive_data_len = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.first_burst_len = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.max_outstanding_r2t = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.max_burst_len = 0
Jul 31 18:58:06 user nova-compute[72810]: iface.chap_auth = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.bidi_chap = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.strict_login_compliance = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.discovery_auth = <empty>
Jul 31 18:58:06 user nova-compute[72810]: iface.discovery_logout = <empty>
Jul 31 18:58:06 user nova-compute[72810]: node.discovery_address = <empty>
Jul 31 18:58:06 user nova-compute[72810]: node.discovery_port = 0
Jul 31 18:58:06 user nova-compute[72810]: node.discovery_type = static
Jul 31 18:58:06 user nova-compute[72810]: node.session.initial_cmdsn = 0
Jul 31 18:58:06 user nova-compute[72810]: node.session.initial_login_retry_max = 8
Jul 31 18:58:06 user nova-compute[72810]: node.session.xmit_thread_priority = -20
Jul 31 18:58:06 user nova-compute[72810]: node.session.cmds_max = 128
Jul 31 18:58:06 user nova-compute[72810]: node.session.queue_depth = 32
Jul 31 18:58:06 user nova-compute[72810]: node.session.nr_sessions = 1
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.authmethod = CHAP
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.username = rnyFdhzM
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.password = ***
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.username_in = <empty>
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.password_in = <empty>
Jul 31 18:58:06 user nova-compute[72810]: node.session.auth.chap_algs = MD5
Jul 31 18:58:06 user nova-compute[72810]: node.session.timeo.replacement_timeout = 120
Jul 31 18:58:06 user nova-compute[72810]: node.session.err_timeo.abort_timeout = 15
Jul 31 18:58:06 user nova-compute[72810]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 18:58:06 user nova-compute[72810]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 18:58:06 user nova-compute[72810]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.FastAbort = Yes
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.InitialR2T = No
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.ImmediateData = Yes
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.MaxConnections = 1
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 18:58:06 user nova-compute[72810]: node.session.iscsi.ERL = 0
Jul 31 18:58:06 user nova-compute[72810]: node.session.scan = manual
Jul 31 18:58:06 user nova-compute[72810]: node.session.reopen_max = 0
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].address = 172.16.0.220
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].port = 3260
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].startup = manual
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].tcp.window_size = 524288
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].tcp.type_of_service = 0
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].timeo.logout_timeout = 15
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].timeo.login_timeout = 15
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].timeo.auth_timeout = 45
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.DataDigest = None
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.IFMarker = No
Jul 31 18:58:06 user nova-compute[72810]: node.conn[0].iscsi.OFMarker = No
Jul 31 18:58:06 user nova-compute[72810]: # END RECORD
Jul 31 18:58:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6049da3-88aa-4eaf-afce-fb9343286307]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00755ba-8300-4f90-85d2-8472ab56fb6b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnyFdhzM {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnyFdhzM" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ea6515-ba37-4eab-ab02-5b60bda122c8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnyFdhzM'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09dba2-866b-474e-a8de-cf6c40af1b76]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41faacd-12c9-4d35-a340-ac10a7a24901]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:06 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:06 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] HCTL ('34', '0', '0', 0) found on session 40 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b08969-c32d-435d-930f-47d79749d8a7]: (4, ('0 0 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Searching for a device in session 40 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23639316139623262', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639316139623262', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-842845383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-842845383',id=35,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-2eloz3fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T18:56:38Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=8d91e596-3d85-41e7-961a-bf9105555be1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:7c:ba:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "vif_mac": "fa:16:3e:7c:ba:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 18:58:06 user nova-compute[72810]:   <uuid>8d91e596-3d85-41e7-961a-bf9105555be1</uuid>
Jul 31 18:58:06 user nova-compute[72810]:   <name>instance-00000023</name>
Jul 31 18:58:06 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 18:58:06 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 18:58:06 user nova-compute[72810]:   <metadata>
Jul 31 18:58:06 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 18:58:06 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-842845383</nova:name>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:creationTime>2023-07-31 18:58:06</nova:creationTime>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 18:58:06 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 18:58:06 user nova-compute[72810]:       </nova:flavor>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:owner>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:user uuid="ef3882653e7244108f590048754d86b3">tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member</nova:user>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:project uuid="cb86a791f5464179b055746ede494239">tempest-ServerBootFromVolumeStableRescueTest-821870912</nova:project>
Jul 31 18:58:06 user nova-compute[72810]:       </nova:owner>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 18:58:06 user nova-compute[72810]:       <nova:ports>
Jul 31 18:58:06 user nova-compute[72810]:         <nova:port uuid="59b8eb7f-c76e-4d61-a35e-cace57809ddb">
Jul 31 18:58:06 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 18:58:06 user nova-compute[72810]:         </nova:port>
Jul 31 18:58:06 user nova-compute[72810]:       </nova:ports>
Jul 31 18:58:06 user nova-compute[72810]:     </nova:instance>
Jul 31 18:58:06 user nova-compute[72810]:   </metadata>
Jul 31 18:58:06 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 18:58:06 user nova-compute[72810]:     <system>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="serial">8d91e596-3d85-41e7-961a-bf9105555be1</entry>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="uuid">8d91e596-3d85-41e7-961a-bf9105555be1</entry>
Jul 31 18:58:06 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 18:58:06 user nova-compute[72810]:     </system>
Jul 31 18:58:06 user nova-compute[72810]:   </sysinfo>
Jul 31 18:58:06 user nova-compute[72810]:   <os>
Jul 31 18:58:06 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 18:58:06 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 18:58:06 user nova-compute[72810]:   </os>
Jul 31 18:58:06 user nova-compute[72810]:   <features>
Jul 31 18:58:06 user nova-compute[72810]:     <acpi/>
Jul 31 18:58:06 user nova-compute[72810]:     <apic/>
Jul 31 18:58:06 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 18:58:06 user nova-compute[72810]:   </features>
Jul 31 18:58:06 user nova-compute[72810]:   <clock offset="utc">
Jul 31 18:58:06 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 18:58:06 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 18:58:06 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 18:58:06 user nova-compute[72810]:   </clock>
Jul 31 18:58:06 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 18:58:06 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 18:58:06 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 18:58:06 user nova-compute[72810]:   </cpu>
Jul 31 18:58:06 user nova-compute[72810]:   <devices>
Jul 31 18:58:06 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 18:58:06 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:06 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 18:58:06 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 18:58:06 user nova-compute[72810]:       <serial>cda4ec83-9413-4ebe-b61e-16029089dff5</serial>
Jul 31 18:58:06 user nova-compute[72810]:     </disk>
Jul 31 18:58:06 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 18:58:06 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 18:58:06 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue"/>
Jul 31 18:58:06 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 18:58:06 user nova-compute[72810]:       <boot order="1"/>
Jul 31 18:58:06 user nova-compute[72810]:     </disk>
Jul 31 18:58:06 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 18:58:06 user nova-compute[72810]:       <mac address="fa:16:3e:7c:ba:40"/>
Jul 31 18:58:06 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:58:06 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 18:58:06 user nova-compute[72810]:       <target dev="tap59b8eb7f-c7"/>
Jul 31 18:58:06 user nova-compute[72810]:     </interface>
Jul 31 18:58:06 user nova-compute[72810]:     <serial type="pty">
Jul 31 18:58:06 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/console.log" append="off"/>
Jul 31 18:58:06 user nova-compute[72810]:     </serial>
Jul 31 18:58:06 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 18:58:06 user nova-compute[72810]:     <video>
Jul 31 18:58:06 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 18:58:06 user nova-compute[72810]:     </video>
Jul 31 18:58:06 user nova-compute[72810]:     <rng model="virtio">
Jul 31 18:58:06 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 18:58:06 user nova-compute[72810]:     </rng>
Jul 31 18:58:06 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 18:58:06 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 18:58:06 user nova-compute[72810]:       <stats period="10"/>
Jul 31 18:58:06 user nova-compute[72810]:     </memballoon>
Jul 31 18:58:06 user nova-compute[72810]:   </devices>
Jul 31 18:58:06 user nova-compute[72810]: </domain>
Jul 31 18:58:06 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 18:58:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance destroyed successfully.
Jul 31 18:58:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] No VIF found with MAC fa:16:3e:7c:ba:40, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:58:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:58:08 user nova-compute[72810]: WARNING nova.compute.manager [req-072bcb73-efac-415e-a188-7997c12d0b77 req-d7037766-d784-4441-b5d3-06fc5529ed7c service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state active and task_state rescuing.
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:58:10 user nova-compute[72810]: WARNING nova.compute.manager [req-7e21b561-49f8-4be8-b3df-ef856a7afb89 req-02d79925-c924-4937-b2c2-3772e2c82764 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state active and task_state rescuing.
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for 8d91e596-3d85-41e7-961a-bf9105555be1 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829890.705578, 8d91e596-3d85-41e7-961a-bf9105555be1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:58:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Resumed (Lifecycle Event)
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b60bf817-03e2-4893-86ab-74aed5d892b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:58:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829890.706887, 8d91e596-3d85-41e7-961a-bf9105555be1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:58:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Started (Lifecycle Event)
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:58:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:58:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:58:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:25 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-changed-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Refreshing instance network info cache due to event network-changed-bb6de756-f05b-4d3a-8e62-fb36db4fd89b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] Acquiring lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] Acquired lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Refreshing network info cache for port bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:28 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:58:28 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=25.140159606933594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:28 user nova-compute[72810]: INFO nova.compute.manager [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attaching volume 127ca089-5747-4e5f-888c-3cf05d51b5a9 to /dev/vdb
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c436cc3-6db2-4f3b-a967-d70bfd55d797]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ee3aca-2d20-4de9-916e-7fa4ad5da7ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bab15ef-1971-4159-ad42-64ff1a71a854]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 36d5fe03-adf6-4c49-a691-435a0f282972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d5566068-a0b7-4c77-a73a-e30ce589fa4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[17453bbc-e48b-4783-96a7-7e9837c72f95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:28 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:58:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2d0c15-e402-4c43-8400-bbeae3778845]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:28 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating existing volume attachment record: 464cfe68-8303-4228-98ca-c311d966960c {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:29 user nova-compute[72810]: INFO nova.compute.manager [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attaching volume bb402b59-75a4-419b-b733-44b32306f144 to /dev/vdb
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.utils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0083dc-0e48-493d-b324-579f111c8ced]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updated VIF entry in instance network info cache for port bb6de756-f05b-4d3a-8e62-fb36db4fd89b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating instance_info_cache with network_info: [{"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e29f88-d50d-42b1-942b-b67ca68503fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e745c29d-f6f0-4496-890c-9826c647b59a req-8903d7e3-de86-4700-80a6-a26bae474dd3 service nova] Releasing lock "refresh_cache-36d5fe03-adf6-4c49-a691-435a0f282972" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a811e3-56bf-4fc6-83bd-4447c1c5b392]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da37d3-8615-4eee-869f-4fb912ee9fc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:29 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:58:29 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38f26b-9dd6-479a-ae3e-cd4407f8d010]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG os_brick.utils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:29 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating existing volume attachment record: 7a8582f6-9cda-42c8-8e40-465c3ab38123 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:58:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:58:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:58:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:58:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [{"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-a3bc5689-d177-44f9-9cd8-d8194d711be3" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:58:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzcYuhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:36 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[080233da-d38a-466c-8507-07d1e92717c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:58:36 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03481e4-3b7d-43bb-b265-dcc5753b32f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9] added
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d55c416-0547-421e-b23f-69a8e20c1900]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[98be765a-159a-434a-a6e5-34e91d79a9f1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXzcYuhw {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXzcYuhw" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9caead-3916-418d-a172-e95a35a6ec75]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXzcYuhw'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[61469e47-dd42-466e-b20a-872eae113429]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcd312e-2591-4ee7-a44c-312efb7d52c3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f360c5-7c6b-436e-ab0b-60466c36aefa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260]
Jul 31 18:58:36 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260] successful.
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbb727-2cdc-4d48-a848-d492e149183c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc66d6f-0e35-4263-8756-88c36ce79e55]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce20ac-eb47-40a9-8d0f-a80e9ac35605]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzcYuhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgzPbfOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23264316134393765', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264316134393765', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.962s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:37 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:37 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG nova.objects.instance [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c7412-db97-407d-bf91-c91012fdbd80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:58:37 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:58:37 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:37 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:37 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:58:37 user nova-compute[72810]:   <serial>127ca089-5747-4e5f-888c-3cf05d51b5a9</serial>
Jul 31 18:58:37 user nova-compute[72810]: </disk>
Jul 31 18:58:37 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba4018-8b73-4987-a02a-417ef4b3e691]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144] added
Jul 31 18:58:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c02bc-e9cd-4f8c-a7ff-59a1159d0c79]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da6ea7f-c188-4ed5-96a2-2d6520be4c34]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgzPbfOL {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgzPbfOL" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbf20c7-3d4a-4be6-b395-d474a00bd70c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GgzPbfOL'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef29b4e-f92b-4e37-99c5-ab0a7cc11f85]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c073cc8-b402-42c5-a5f4-e7db94d09adc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:37 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:37 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:37 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:37 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab337c-5c95-47a1-969a-3f74233d54ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260]
Jul 31 18:58:37 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260] successful.
Jul 31 18:58:37 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d61ad43-61ea-478a-bc74-57f90886c80f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9728958-3293-4d01-9681-eacbe8f42be6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:38 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8415fc-d6c1-4ac2-a66d-e9e66cdf3698]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgzPbfOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No VIF found with MAC fa:16:3e:dd:61:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-adc253bd-fa3a-49fc-b80d-44a9b31af46f tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.596s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== connect_volume: return (2305ms) {'type': 'block', 'scsi_wwn': '23934376661353530', 'path': '/dev/sde'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934376661353530', 'path': '/dev/sde'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:58:39 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:39 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:58:39 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:58:39 user nova-compute[72810]:   <serial>bb402b59-75a4-419b-b733-44b32306f144</serial>
Jul 31 18:58:39 user nova-compute[72810]: </disk>
Jul 31 18:58:39 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No VIF found with MAC fa:16:3e:c9:0d:4a, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:58:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5aab84db-44ed-4e11-8c18-796713f301dd tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.517s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:40 user nova-compute[72810]: INFO nova.compute.manager [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Detaching volume 127ca089-5747-4e5f-888c-3cf05d51b5a9
Jul 31 18:58:40 user nova-compute[72810]: INFO nova.virt.block_device [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attempting to driver detach volume 127ca089-5747-4e5f-888c-3cf05d51b5a9 from mountpoint /dev/vdb
Jul 31 18:58:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Attempting to detach device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:58:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:58:40 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:40 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:40 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:58:40 user nova-compute[72810]:   <serial>127ca089-5747-4e5f-888c-3cf05d51b5a9</serial>
Jul 31 18:58:40 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:58:40 user nova-compute[72810]: </disk>
Jul 31 18:58:40 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:58:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config.
Jul 31 18:58:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:58:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:58:40 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:40 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:40 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:58:40 user nova-compute[72810]:   <serial>127ca089-5747-4e5f-888c-3cf05d51b5a9</serial>
Jul 31 18:58:40 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:58:40 user nova-compute[72810]: </disk>
Jul 31 18:58:40 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829921.1405048, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:58:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config.
Jul 31 18:58:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzcYuhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:41 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f52fec-977b-4204-b64c-36bd96678d36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f8dea-4a65-4496-a3ec-96d0133a03ae]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc537640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c9f47e-dc29-48ee-a3e9-fa5ab520a4b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c652b63-2fe9-41e5-89fb-8a5519077d67]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3d61f-4b70-423a-b9ef-dbb702998bc3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c992767-84cd-4cd6-9687-0da9dfa025a2]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bb697d-96b7-45e0-9456-1d0f648f788d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7ad2e-448a-4533-ac31-6f74eaaf9e39]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260]
Jul 31 18:58:41 user nova-compute[72810]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9, portal: 172.16.0.220,3260] successful.
Jul 31 18:58:41 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127ca089-5747-4e5f-888c-3cf05d51b5a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4439cd9-6209-4e93-977f-24a46ffeae5c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== disconnect_volume: return (285ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5cef725f-8232-456d-8ce7-be94217787c7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:42 user nova-compute[72810]: INFO nova.compute.manager [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attaching volume c96616e9-745c-4cc2-a54f-a218ae6b6cc4 to /dev/vdc
Jul 31 18:58:42 user nova-compute[72810]: DEBUG os_brick.utils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb49c35-6023-435e-9d52-abf26be29b56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a31417-4ad1-454e-bc7a-ade7557acb44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bced00-7358-4f29-88e5-925baa0cbb03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a66def-f3fd-4d70-b285-66f9d4e26953]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:58:43 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:58:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af71f2b-3eb6-4196-bb58-2eef0d53019d]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG os_brick.utils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating existing volume attachment record: 513e7213-c977-4bdf-bf33-dfbbaedb5497 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:58:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJSFheBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:50 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:50 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:50 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba2fae-e04d-4a31-ba00-8e3444edf8a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:58:50 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[883037b5-fb94-4505-9cc9-d98df7a20748]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4] added
Jul 31 18:58:50 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77baa96-7855-4996-89fd-d47106488376]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bdbd1f-f15d-458d-af81-0b2f65d6fc11]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJSFheBn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJSFheBn" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[97623a1e-1441-47f4-a4b4-ddba91faa1b6]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJSFheBn'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6860bc-d924-46ae-872a-6b7956c96d1f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa7f381-2942-4bf8-b351-24b6be1b6e5f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[76166999-ac5f-425e-b540-aab9eb1e2c94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260]
Jul 31 18:58:51 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260] successful.
Jul 31 18:58:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5f2777-ded8-4709-bcb2-a0f97edc9242]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[952244d5-0e69-448d-bed1-ef0eb559afb8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)
Jul 31 18:58:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd99f6d-1623-4e51-a547-045f8412873b]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:58:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJSFheBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26138663030623666', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138663030623666', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:58:52 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:52 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:52 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:58:52 user nova-compute[72810]:   <serial>c96616e9-745c-4cc2-a54f-a218ae6b6cc4</serial>
Jul 31 18:58:52 user nova-compute[72810]: </disk>
Jul 31 18:58:52 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] No VIF found with MAC fa:16:3e:c9:0d:4a, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:58:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-87c19e68-f841-49eb-9df0-a91bb1f4b25b tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.885s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:58:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:58:53 user nova-compute[72810]: INFO nova.compute.manager [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Detaching volume c96616e9-745c-4cc2-a54f-a218ae6b6cc4
Jul 31 18:58:53 user nova-compute[72810]: INFO nova.virt.block_device [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attempting to driver detach volume c96616e9-745c-4cc2-a54f-a218ae6b6cc4 from mountpoint /dev/vdc
Jul 31 18:58:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Attempting to detach device vdc from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:58:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:58:53 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:53 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:53 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:58:53 user nova-compute[72810]:   <serial>c96616e9-745c-4cc2-a54f-a218ae6b6cc4</serial>
Jul 31 18:58:53 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:58:53 user nova-compute[72810]: </disk>
Jul 31 18:58:53 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:58:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully detached device vdc from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the persistent domain config.
Jul 31 18:58:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:58:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:58:53 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:58:53 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:58:53 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 18:58:53 user nova-compute[72810]:   <serial>c96616e9-745c-4cc2-a54f-a218ae6b6cc4</serial>
Jul 31 18:58:53 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 18:58:53 user nova-compute[72810]: </disk>
Jul 31 18:58:53 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829934.4011645, 36d5fe03-adf6-4c49-a691-435a0f282972 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:58:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully detached device vdc from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the live domain config.
Jul 31 18:58:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJSFheBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:58:54 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368e54f-ac23-4d16-939d-d490dbf6ceea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e58246-87df-47a3-a979-09a10e815596]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 (non-flash)
Jul 31 18:58:54 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4311630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11d0fb9-b95d-421e-9a49-d94eaa210abe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a5af2a-ad1b-439d-bfee-42aa751336fc]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[79890670-5799-4a86-9de1-d7280bb7f3b1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131bb83-b798-4704-842f-25dcf1a4e8ad]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d26da7d-0812-4ebe-82c7-69777a1728af]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610f73b-2d3c-4bcc-8f81-17f771cf145d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260]
Jul 31 18:58:54 user nova-compute[72810]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4, portal: 172.16.0.220,3260] successful.
Jul 31 18:58:54 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c96616e9-745c-4cc2-a54f-a218ae6b6cc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7d8c9-66fc-4a54-95de-181940f4faa2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== disconnect_volume: return (283ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:58:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:58:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:58:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e3aa99e5-3418-4917-8dd2-3a72a473db6d tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.628s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:58:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:59:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:59:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:29 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:59:29 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=7962MB free_disk=25.12875747680664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 36d5fe03-adf6-4c49-a691-435a0f282972 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d5566068-a0b7-4c77-a73a-e30ce589fa4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 18:59:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing instance network info cache due to event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:59:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:59:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:59:30 user nova-compute[72810]: DEBUG nova.network.neutron [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updated VIF entry in instance network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5d4b8d4-f527-4e0a-84a5-dc24bfe3c639 req-e5f9ffd8-0ab0-4274-8520-115a30c6a2b4 service nova] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:59:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updating instance_info_cache with network_info: [{"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-aa8a0c74-8b74-4184-a07a-14cd99b71a37" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 18:59:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 18:59:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:35 user nova-compute[72810]: INFO nova.compute.manager [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attaching volume 6ba9d772-ac98-498c-89fb-8f2669b00efc to /dev/vdb
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ed009-c3e4-40ef-8cec-8efc29ba97a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[396553e9-f3a0-44ad-93a4-8135c691ff58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[729b4ef0-9fa4-44ae-9348-814244ce7ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb9502-019f-4767-acf9-bb3bd499d4e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 18:59:35 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82ed4b-ffbf-407a-80ee-d168b9a1d3f9]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG os_brick.utils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating existing volume attachment record: e33bd3bf-02b9-4620-8755-32c19874991f {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:35 user nova-compute[72810]: INFO nova.compute.manager [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Shelving
Jul 31 18:59:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:35 user nova-compute[72810]: WARNING nova.compute.manager [req-9f581a2b-63b9-4a33-a768-c7d09e9cfc56 req-b6448a4c-0ef2-4179-a41f-d6483d0ea4ee service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state active and task_state shelving.
Jul 31 18:59:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance destroyed successfully.
Jul 31 18:59:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Beginning cold snapshot process
Jul 31 18:59:36 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 18:59:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk /opt/stack/data/nova/instances/snapshots/tmpzn0gq_h9/ad09177c358b42019376ed0d24ad89f0 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk /opt/stack/data/nova/instances/snapshots/tmpzn0gq_h9/ad09177c358b42019376ed0d24ad89f0" returned: 0 in 0.881s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Snapshot extracted, beginning image upload
Jul 31 18:59:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:37 user nova-compute[72810]: WARNING nova.compute.manager [req-7d0f786c-d00a-44b3-b022-cf6eb0ef7313 req-db5bbe49-c0f8-4aa9-ad6e-c9324afd9f67 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 18:59:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Snapshot image upload complete
Jul 31 18:59:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:39 user nova-compute[72810]: INFO nova.compute.manager [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Shelve offloading
Jul 31 18:59:39 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance destroyed successfully.
Jul 31 18:59:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:59:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:59:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:59:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:59:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:59:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance destroyed successfully.
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'resources' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPefv6bMov76QfWm4jIXUtqGj2kNw9CQutsTRR/ZCka+5tC34J6MTEcrmXgBdbECqxMwjz4tcBozwKvnnl4tNpJBpECiHuGPl8+INoH6J1+Fb/r/lEtBdgcHbRVkV7aQtA==',key_name='tempest-keypair-1934194688',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T18:59:39.582726',shelved_host='user',shelved_image_id='6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG os_vif [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcac99b5c-b7, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:41 user nova-compute[72810]: INFO os_vif [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7')
Jul 31 18:59:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Deleting instance files /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a_del
Jul 31 18:59:41 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Deletion of /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a_del complete
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing instance network info cache due to event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 18:59:41 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Deleted allocations for instance d5566068-a0b7-4c77-a73a-e30ce589fa4a
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'numa_topology' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e774fb2b-e33d-4520-b273-8c2aad30ef8d tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.951s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updated VIF entry in instance network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG nova.network.neutron [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:59:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-abdccd59-1571-4f73-9609-36ad833cd333 req-35769bb4-952a-4aa5-902f-f366c6cd4f8e service nova] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBUGIpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:59:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:59:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:59:42 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020cdc3-d99b-4663-810d-825dad5392bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 18:59:42 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f0821-8791-4b5e-b117-95fe1dc13703]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc] added
Jul 31 18:59:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0465579-ff91-40d2-b21e-3ef2fd2f180c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca6e88-ef86-41fa-b93d-0b73150676d7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSBUGIpJ {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSBUGIpJ" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d7222-7627-42ed-a0a0-c8a4ba6300aa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSBUGIpJ'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee0d1e9-b21a-4103-b80e-d507b1d5f171]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c94ccb-e0e7-472a-85db-027ec71b1e02]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:42 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:42 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:42 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:42 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:59:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f251e-7a5e-4fdf-a448-8b88bc9667d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260]
Jul 31 18:59:43 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260] successful.
Jul 31 18:59:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cff827-fcc1-413d-9608-a233f6a3203d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f87d28-230b-4f54-9468-df3b427f9c01]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:43 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c1d1b-2089-481c-82c9-942e77220b1a]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 18:59:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBUGIpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23239393564363562', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239393564363562', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 18:59:44 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:59:44 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:59:44 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:59:44 user nova-compute[72810]:   <serial>6ba9d772-ac98-498c-89fb-8f2669b00efc</serial>
Jul 31 18:59:44 user nova-compute[72810]: </disk>
Jul 31 18:59:44 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:44 user nova-compute[72810]: INFO nova.compute.manager [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Detaching volume bb402b59-75a4-419b-b733-44b32306f144
Jul 31 18:59:44 user nova-compute[72810]: INFO nova.virt.block_device [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Attempting to driver detach volume bb402b59-75a4-419b-b733-44b32306f144 from mountpoint /dev/vdb
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Attempting to detach device vdb from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:59:44 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:59:44 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:59:44 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:59:44 user nova-compute[72810]:   <serial>bb402b59-75a4-419b-b733-44b32306f144</serial>
Jul 31 18:59:44 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:59:44 user nova-compute[72810]: </disk>
Jul 31 18:59:44 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:59:44 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully detached device vdb from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the persistent domain config.
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:59:44 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:59:44 user nova-compute[72810]:   <source dev="/dev/sde"/>
Jul 31 18:59:44 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:59:44 user nova-compute[72810]:   <serial>bb402b59-75a4-419b-b733-44b32306f144</serial>
Jul 31 18:59:44 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:59:44 user nova-compute[72810]: </disk>
Jul 31 18:59:44 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] No VIF found with MAC fa:16:3e:dd:61:29, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 18:59:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b60b31fc-2740-4934-b50b-fd5be9343d38 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.613s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829985.0328507, 36d5fe03-adf6-4c49-a691-435a0f282972 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:59:45 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully detached device vdb from instance 36d5fe03-adf6-4c49-a691-435a0f282972 from the live domain config.
Jul 31 18:59:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgzPbfOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:59:45 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[157a10a2-18a0-4d2b-95c7-e91a2ed72d41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6963b606-4766-4c05-aa43-5cdff61fd09f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 (non-flash)
Jul 31 18:59:45 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc49b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144'): ({'sde'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Removing single pathed devices sde {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b657ab1-593f-4e05-a52c-da70db3363c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7f1db-6b61-4cf9-9351-c7225cab4cf3]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Flushing IO for device /dev/sde {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79a519-0626-4833-806a-31a1edcdcf0d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad592ce-bbbc-4557-a615-27e16d8606bc]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] SCSI volumes sde have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fac27c-372f-4b81-9b53-a56bde23929b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f1ab4-7b00-4c30-80c6-c4ddc9887785]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260]
Jul 31 18:59:45 user nova-compute[72810]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144, portal: 172.16.0.220,3260] successful.
Jul 31 18:59:45 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb402b59-75a4-419b-b733-44b32306f144 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03a3177-4843-46db-b95d-42794acff789]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] <== disconnect_volume: return (266ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:59:45 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:59:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'flavor' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-5d4ec710-f0d9-48d7-af74-98b9c96a0146 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:47 user nova-compute[72810]: INFO nova.compute.manager [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Detaching volume 6ba9d772-ac98-498c-89fb-8f2669b00efc
Jul 31 18:59:47 user nova-compute[72810]: INFO nova.virt.block_device [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Attempting to driver detach volume 6ba9d772-ac98-498c-89fb-8f2669b00efc from mountpoint /dev/vdb
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Attempting to detach device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:59:47 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:59:47 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:59:47 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:59:47 user nova-compute[72810]:   <serial>6ba9d772-ac98-498c-89fb-8f2669b00efc</serial>
Jul 31 18:59:47 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:59:47 user nova-compute[72810]: </disk>
Jul 31 18:59:47 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:59:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the persistent domain config.
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 18:59:47 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 18:59:47 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 18:59:47 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 18:59:47 user nova-compute[72810]:   <serial>6ba9d772-ac98-498c-89fb-8f2669b00efc</serial>
Jul 31 18:59:47 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 18:59:47 user nova-compute[72810]: </disk>
Jul 31 18:59:47 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690829987.9383976, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 18:59:47 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully detached device vdb from instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba from the live domain config.
Jul 31 18:59:47 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSBUGIpJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 18:59:47 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e35dc-b149-47c5-a337-10947342a1f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8a98a-32f6-4e39-bc24-7f48cca55bd7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:47 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:47 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:47 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 18:59:47 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 18:59:47 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 18:59:47 user nova-compute[72810]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc (non-flash)
Jul 31 18:59:47 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4276d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b269d-ffce-43ec-a9a6-fe5f17977354]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6affffd0-a854-4fcf-90a6-14d2018271c4]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4166ea0b-8f0c-4d0a-9b2d-01a805d2c579]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d71e650-0a46-4b64-9570-94c6b5619a6e]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec8383-1c68-41b1-925e-6b9b66b0ecda]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc580ebf-7683-42df-ae05-5d9e85c0b59c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260]
Jul 31 18:59:48 user nova-compute[72810]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc, portal: 172.16.0.220,3260] successful.
Jul 31 18:59:48 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ba9d772-ac98-498c-89fb-8f2669b00efc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93dc677-e36b-4b2c-82d1-e727a6f9076b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] <== disconnect_volume: return (249ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG nova.objects.instance [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'flavor' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-79ecbebd-4265-40dc-a860-1f01b386f7d7 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.528s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:51 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690829976.1839592, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:59:51 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Stopped (Lifecycle Event)
Jul 31 18:59:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-282f3512-61df-4c3f-9cc8-090bc10d961b None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:53 user nova-compute[72810]: INFO nova.compute.manager [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Unrescuing
Jul 31 18:59:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 18:59:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquired lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 18:59:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Releasing lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'flavor' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:54 user nova-compute[72810]: WARNING nova.compute.manager [req-8131a378-aa13-49c3-9d63-c18594e2a76e req-b3e1fa83-3505-4116-b36a-8111ba8f25b7 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:59:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance destroyed successfully.
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:56 user nova-compute[72810]: WARNING nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:59:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:56 user nova-compute[72810]: WARNING nova.compute.manager [req-5182fd57-e8ff-498a-843a-1ede758620be req-dcc95ab4-0224-4633-984c-98496f4b1a98 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 18:59:58 user nova-compute[72810]: WARNING nova.compute.manager [req-1802043d-804e-49c8-a8c3-955b3a9366ef req-b833500f-924d-411d-9528-ebf96a32f195 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state rescued and task_state unrescuing.
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for 8d91e596-3d85-41e7-961a-bf9105555be1 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829998.6571782, 8d91e596-3d85-41e7-961a-bf9105555be1 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:59:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Resumed (Lifecycle Event)
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-80f6a418-57ee-486d-a9f2-bb45d4645f6d tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 18:59:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690829998.6587193, 8d91e596-3d85-41e7-961a-bf9105555be1 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 18:59:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Started (Lifecycle Event)
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 18:59:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:00:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:25 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:00:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:29 user nova-compute[72810]: INFO nova.compute.manager [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Terminating instance
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-unplugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] No waiting events found dispatching network-vif-unplugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ba3e011-c6fa-4187-a960-fdb638a48a78 req-b02b20b8-8c65-487b-9729-ac10ab6839ee service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-unplugged-b543dfb8-c43c-4701-b842-db552617e4d8 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:00:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Instance destroyed successfully.
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lazy-loading 'resources' on Instance uuid aa8a0c74-8b74-4184-a07a-14cd99b71a37 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1005811729',display_name='tempest-ServersNegativeTestJSON-server-1005811729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1005811729',id=30,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9cad4967caa4975b8ff989a99d6f868',ramdisk_id='',reservation_id='r-ahbbfd6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-96527336',owner_user_name='tempest-ServersNegativeTestJSON-96527336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:51:44Z,user_data=None,user_id='8f26facd20ff42e89451e548379b789f',uuid=aa8a0c74-8b74-4184-a07a-14cd99b71a37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converting VIF {"id": "b543dfb8-c43c-4701-b842-db552617e4d8", "address": "fa:16:3e:b4:72:ad", "network": {"id": "eaca69f3-5aa4-4434-bd28-954a86cdcef3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1839021822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9cad4967caa4975b8ff989a99d6f868", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb543dfb8-c4", "ovs_interfaceid": "b543dfb8-c43c-4701-b842-db552617e4d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG os_vif [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb543dfb8-c4, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:00:30 user nova-compute[72810]: INFO os_vif [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:72:ad,bridge_name='br-int',has_traffic_filtering=True,id=b543dfb8-c43c-4701-b842-db552617e4d8,network=Network(eaca69f3-5aa4-4434-bd28-954a86cdcef3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb543dfb8-c4')
Jul 31 19:00:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Deleting instance files /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37_del
Jul 31 19:00:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Deletion of /opt/stack/data/nova/instances/aa8a0c74-8b74-4184-a07a-14cd99b71a37_del complete
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:30 user nova-compute[72810]: INFO nova.compute.manager [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Took 0.75 seconds to destroy the instance on the hypervisor.
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-eab83bcb-5ba9-489f-8aeb-0cf9465e6c2e req-4607ed8e-09b2-4bdb-85d8-3278f2f7289c service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-deleted-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:30 user nova-compute[72810]: INFO nova.compute.manager [req-eab83bcb-5ba9-489f-8aeb-0cf9465e6c2e req-4607ed8e-09b2-4bdb-85d8-3278f2f7289c service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Neutron deleted interface b543dfb8-c43c-4701-b842-db552617e4d8; detaching it from the instance and deleting it from the info cache
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.network.neutron [req-eab83bcb-5ba9-489f-8aeb-0cf9465e6c2e req-4607ed8e-09b2-4bdb-85d8-3278f2f7289c service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:00:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:00:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:00:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=25.10686492919922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-eab83bcb-5ba9-489f-8aeb-0cf9465e6c2e req-4607ed8e-09b2-4bdb-85d8-3278f2f7289c service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Detach interface failed, port_id=b543dfb8-c43c-4701-b842-db552617e4d8, reason: Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:00:31 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Took 0.70 seconds to deallocate network for instance.
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance aa8a0c74-8b74-4184-a07a-14cd99b71a37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 36d5fe03-adf6-4c49-a691-435a0f282972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.268s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:31 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Deleted allocations for instance aa8a0c74-8b74-4184-a07a-14cd99b71a37
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8d186930-d78a-4ce2-b7b8-89a8a52b293d tempest-ServersNegativeTestJSON-96527336 tempest-ServersNegativeTestJSON-96527336-project-member] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] Acquiring lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] Lock "aa8a0c74-8b74-4184-a07a-14cd99b71a37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] No waiting events found dispatching network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:00:31 user nova-compute[72810]: WARNING nova.compute.manager [req-67e4cbc3-f603-40d3-bbd7-54db55abeb5f req-3c34606b-a4de-4387-a55b-c2e4b53be8ed service nova] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Received unexpected event network-vif-plugged-b543dfb8-c43c-4701-b842-db552617e4d8 for instance with vm_state deleted and task_state None.
Jul 31 19:00:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:00:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:00:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updating instance_info_cache with network_info: [{"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:00:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-60e683d2-fe34-4191-8c7c-153fe32f5ed0" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:00:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:00:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:34 user nova-compute[72810]: INFO nova.compute.manager [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Terminating instance
Jul 31 19:00:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-unplugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] No waiting events found dispatching network-vif-unplugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-6dfa0b81-f826-4b2c-8330-72538633c468 req-ce18725f-c389-4c5d-8f25-1927b3913267 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-unplugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Instance destroyed successfully.
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lazy-loading 'resources' on Instance uuid 36d5fe03-adf6-4c49-a691-435a0f282972 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1142056251',display_name='tempest-TestServerVolumeAttachmentScenario-server-1142056251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1142056251',id=36,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMa1JDq/yDU6uu58oPfH3zlIlrLOvKEs2p9v9FOyA9oRZsFNxcpi3XZBGE7Z+6R6+/n2Mla/71ttCKcJUBc1Wo7QOo35i05hZqQa9TymHtwzLNHzaJNni76HyehV2oy1g==',key_name='tempest-keypair-1144872895',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:56:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3d5188096584e56ba95e5c5af731aae',ramdisk_id='',reservation_id='r-gqyltc0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-845793169',owner_user_name='tempest-TestServerVolumeAttachmentScenario-845793169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:56:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f32a4a39bdc641929203ee3949cf1245',uuid=36d5fe03-adf6-4c49-a691-435a0f282972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converting VIF {"id": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "address": "fa:16:3e:c9:0d:4a", "network": {"id": "1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1465476145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3d5188096584e56ba95e5c5af731aae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6de756-f0", "ovs_interfaceid": "bb6de756-f05b-4d3a-8e62-fb36db4fd89b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG os_vif [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb6de756-f0, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:35 user nova-compute[72810]: INFO os_vif [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:0d:4a,bridge_name='br-int',has_traffic_filtering=True,id=bb6de756-f05b-4d3a-8e62-fb36db4fd89b,network=Network(1e7c39fc-a4ae-4ed7-abe5-eb67c64deac4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6de756-f0')
Jul 31 19:00:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Deleting instance files /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972_del
Jul 31 19:00:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Deletion of /opt/stack/data/nova/instances/36d5fe03-adf6-4c49-a691-435a0f282972_del complete
Jul 31 19:00:35 user nova-compute[72810]: INFO nova.compute.manager [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:00:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:00:36 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:00:36 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Took 0.95 seconds to deallocate network for instance.
Jul 31 19:00:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:36 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:00:36 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:00:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:36 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Deleted allocations for instance 36d5fe03-adf6-4c49-a691-435a0f282972
Jul 31 19:00:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a0ab9ff5-1066-4f1e-bd19-3b26f9f8f523 tempest-TestServerVolumeAttachmentScenario-845793169 tempest-TestServerVolumeAttachmentScenario-845793169-project-member] Lock "36d5fe03-adf6-4c49-a691-435a0f282972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] Acquiring lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:00:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:00:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] Lock "36d5fe03-adf6-4c49-a691-435a0f282972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:00:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] No waiting events found dispatching network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:00:37 user nova-compute[72810]: WARNING nova.compute.manager [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received unexpected event network-vif-plugged-bb6de756-f05b-4d3a-8e62-fb36db4fd89b for instance with vm_state deleted and task_state None.
Jul 31 19:00:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-5bf1f973-4920-4980-ac31-7b748bf1401d req-f99f71f1-cd72-42b5-a124-91da395ed844 service nova] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Received event network-vif-deleted-bb6de756-f05b-4d3a-8e62-fb36db4fd89b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:00:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830030.1641896, aa8a0c74-8b74-4184-a07a-14cd99b71a37 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:00:45 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] VM Stopped (Lifecycle Event)
Jul 31 19:00:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ea08b6aa-f123-4feb-96c0-ddf5c3975436 None None] [instance: aa8a0c74-8b74-4184-a07a-14cd99b71a37] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:00:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:50 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830035.5561645, 36d5fe03-adf6-4c49-a691-435a0f282972 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:00:50 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] VM Stopped (Lifecycle Event)
Jul 31 19:00:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e904e339-769c-4d62-bbf8-b7aa2b399038 None None] [instance: 36d5fe03-adf6-4c49-a691-435a0f282972] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:00:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:00:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:06 user nova-compute[72810]: INFO nova.compute.manager [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Terminating instance
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-unplugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] No waiting events found dispatching network-vif-unplugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-526dfe0f-039b-460a-9f38-bbb8c7c21195 req-7f6e466a-9757-4ff4-8969-1146d02dafa3 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-unplugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:01:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Instance destroyed successfully.
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.objects.instance [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lazy-loading 'resources' on Instance uuid 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-198065800',display_name='tempest-SnapshotDataIntegrityTests-server-198065800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-198065800',id=34,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvj7uJDxic3Z6EA744e4C+quKGXeEMMiDFZCFqP5lfn22WJAolgG3x9ymx97beVoz6153Zo4+2mAzdaSe9I4GvgaT/kogKZREQ5hQRZww7a1Wv31pOUcTC5onngE4ihRA==',key_name='tempest-keypair-696562392',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:54:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0bb7ce61d874fb1b2bddfcdedd81ed7',ramdisk_id='',reservation_id='r-gi7yg9tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1070122162',owner_user_name='tempest-SnapshotDataIntegrityTests-1070122162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b213b31483f48d2b541e5488c8e73b3',uuid=7736ea8f-3b6d-4d0d-83b8-ec75684dcbba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converting VIF {"id": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "address": "fa:16:3e:dd:61:29", "network": {"id": "7f9412ed-ce94-41d0-a58b-728bee60ca66", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-804495208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0bb7ce61d874fb1b2bddfcdedd81ed7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ce1b861-fd", "ovs_interfaceid": "1ce1b861-fdfd-4e44-a44c-1e921c72c548", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG os_vif [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ce1b861-fd, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:06 user nova-compute[72810]: INFO os_vif [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:61:29,bridge_name='br-int',has_traffic_filtering=True,id=1ce1b861-fdfd-4e44-a44c-1e921c72c548,network=Network(7f9412ed-ce94-41d0-a58b-728bee60ca66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ce1b861-fd')
Jul 31 19:01:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Deleting instance files /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba_del
Jul 31 19:01:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Deletion of /opt/stack/data/nova/instances/7736ea8f-3b6d-4d0d-83b8-ec75684dcbba_del complete
Jul 31 19:01:06 user nova-compute[72810]: INFO nova.compute.manager [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 19:01:06 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:01:06 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:08 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Took 1.21 seconds to deallocate network for instance.
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-b2ebb0d9-68ca-4f78-8bc7-b4fa3efecebd req-5104798b-287b-45b9-b8a5-6a741b31e42e service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-deleted-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:08 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Deleted allocations for instance 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-71e7032a-482d-4a30-9c71-22d1baaaac40 tempest-SnapshotDataIntegrityTests-1070122162 tempest-SnapshotDataIntegrityTests-1070122162-project-member] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] Acquiring lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] Lock "7736ea8f-3b6d-4d0d-83b8-ec75684dcbba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] No waiting events found dispatching network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:08 user nova-compute[72810]: WARNING nova.compute.manager [req-9edcd4dc-8dec-4ba4-a98c-3e6dd1b74089 req-88769633-c485-459c-ab2a-c75cdb799274 service nova] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Received unexpected event network-vif-plugged-1ce1b861-fdfd-4e44-a44c-1e921c72c548 for instance with vm_state deleted and task_state None.
Jul 31 19:01:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:01:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:21 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830066.828118, 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:01:21 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] VM Stopped (Lifecycle Event)
Jul 31 19:01:21 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4c86b0f6-44af-464e-9f3c-eb4fe6048b53 None None] [instance: 7736ea8f-3b6d-4d0d-83b8-ec75684dcbba] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:28 user nova-compute[72810]: INFO nova.compute.manager [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Unshelving
Jul 31 19:01:28 user nova-compute[72810]: INFO nova.virt.block_device [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Booting with volume 12a0fbdf-42be-4960-b16f-1725ee42bf13 at /dev/vdc
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1aa66c-e25c-4d0d-b84d-385ed935ba43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b150810b-c360-4dff-b687-fec1ee484b37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[894f5672-8444-4fc6-a6d0-415ca8f7a3a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c17cdd-26bc-4799-b9ef-ed9b7860fcc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:01:28 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e1124-de4f-492f-9dbd-71076b8fe9ed]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating existing volume attachment record: 2210c58e-c476-4975-9e8e-30452c94bfc6 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:28 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8372MB free_disk=25.188655853271484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8d91e596-3d85-41e7-961a-bf9105555be1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d5566068-a0b7-4c77-a73a-e30ce589fa4a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:01:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.705s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:01:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:01:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:01:34 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:01:35 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [{"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-8d91e596-3d85-41e7-961a-bf9105555be1" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:01:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:01:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_requests' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'numa_topology' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:01:36 user nova-compute[72810]: INFO nova.compute.claims [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Claim successful on node user
Jul 31 19:01:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:36 user nova-compute[72810]: INFO nova.network.neutron [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating port cac99b5c-b78f-499d-8a23-d73c76d3729f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 19:01:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing instance network info cache due to event network-changed-cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] Acquiring lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:01:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Creating image(s)
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] Acquired lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG nova.network.neutron [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Refreshing network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG nova.virt.images [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] 6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.part /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.part /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.converted" returned: 0 in 0.455s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updated VIF entry in instance network info cache for port cac99b5c-b78f-499d-8a23-d73c76d3729f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG nova.network.neutron [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2664186d-d98b-44aa-9004-69455e17ab86 req-734a68ad-dfa0-4e1f-888e-a9acee9ff1fa service nova] Releasing lock "refresh_cache-d5566068-a0b7-4c77-a73a-e30ce589fa4a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.819s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad,backing_fmt=raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad,backing_fmt=raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk 1073741824" returned: 0 in 0.057s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "f0a9cb139fd71d595cb8c22a906fdb9785d89aad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'migration_context' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Rebasing disk image.
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 -F raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 -F raw /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk" returned: 0 in 2.098s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Ensure instance console log exists: /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start _get_guest_xml network_info=[{"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b3fddf232b65b3ce12230f54c6b7bd3b',container_format='bare',created_at=2023-07-31T18:59:36Z,direct_url=<?>,disk_format='qcow2',id=6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1911600020-shelved',owner='b7e7dddc0de04feb9cc40460f2f5fe68',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T18:59:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySrmatjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd5566068-a0b7-4c77-a73a-e30ce589fa4a', 'attached_at': '', 'detached_at': '', 'volume_id': '12a0fbdf-42be-4960-b16f-1725ee42bf13', 'serial': '12a0fbdf-42be-4960-b16f-1725ee42bf13'}, 'attachment_id': '2210c58e-c476-4975-9e8e-30452c94bfc6', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:01:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b3fddf232b65b3ce12230f54c6b7bd3b',container_format='bare',created_at=2023-07-31T18:59:36Z,direct_url=<?>,disk_format='qcow2',id=6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1911600020-shelved',owner='b7e7dddc0de04feb9cc40460f2f5fe68',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T18:59:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySrmatjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:01:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:01:42 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:01:42 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd725e0-dc0e-43a3-ac0f-75f18b3b2be3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:01:42 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a70fd2-afd9-4c3f-986f-1c6a2399aacf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13] added
Jul 31 19:01:42 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[952285d9-be61-4468-8550-4295153c2da8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2b7512-a427-41ec-bdcb-0af47bc83162]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySrmatjg {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ySrmatjg" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[048abf7d-1c67-4fdc-a16b-67536d76f9b9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ySrmatjg'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f9096-9825-4b56-ab2c-db8777d9ce89]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df0079-3b0f-41b2-8ac4-415cfc2ee910]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e40f590-5c76-4edf-847b-cc6d2b19cdac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260]
Jul 31 19:01:43 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260] successful.
Jul 31 19:01:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[463452f2-c52b-40b6-8b89-0e9248c70ecc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[de96a119-199a-47f8-818a-847aa39e1f38]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:01:43 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcfbb90-9a9e-4df2-9ca2-b9380e8401a6]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySrmatjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:01:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23738353738623336', 'path': '/dev/sdd'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738353738623336', 'path': '/dev/sdd'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1934194688',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T18:59:39.582726',shelved_host='user',shelved_image_id='6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_devices' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:01:44 user nova-compute[72810]:   <uuid>d5566068-a0b7-4c77-a73a-e30ce589fa4a</uuid>
Jul 31 19:01:44 user nova-compute[72810]:   <name>instance-00000025</name>
Jul 31 19:01:44 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:01:44 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:01:44 user nova-compute[72810]:   <metadata>
Jul 31 19:01:44 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:01:44 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1911600020</nova:name>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:01:42</nova:creationTime>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:01:44 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:01:44 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:owner>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:user uuid="145454abe36e4eb990a0431c1bcebc43">tempest-AttachVolumeShelveTestJSON-1432800121-project-member</nova:user>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:project uuid="b7e7dddc0de04feb9cc40460f2f5fe68">tempest-AttachVolumeShelveTestJSON-1432800121</nova:project>
Jul 31 19:01:44 user nova-compute[72810]:       </nova:owner>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:root type="image" uuid="6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f"/>
Jul 31 19:01:44 user nova-compute[72810]:       <nova:ports>
Jul 31 19:01:44 user nova-compute[72810]:         <nova:port uuid="cac99b5c-b78f-499d-8a23-d73c76d3729f">
Jul 31 19:01:44 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 19:01:44 user nova-compute[72810]:         </nova:port>
Jul 31 19:01:44 user nova-compute[72810]:       </nova:ports>
Jul 31 19:01:44 user nova-compute[72810]:     </nova:instance>
Jul 31 19:01:44 user nova-compute[72810]:   </metadata>
Jul 31 19:01:44 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:01:44 user nova-compute[72810]:     <system>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="serial">d5566068-a0b7-4c77-a73a-e30ce589fa4a</entry>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="uuid">d5566068-a0b7-4c77-a73a-e30ce589fa4a</entry>
Jul 31 19:01:44 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:01:44 user nova-compute[72810]:     </system>
Jul 31 19:01:44 user nova-compute[72810]:   </sysinfo>
Jul 31 19:01:44 user nova-compute[72810]:   <os>
Jul 31 19:01:44 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:01:44 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:01:44 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:01:44 user nova-compute[72810]:   </os>
Jul 31 19:01:44 user nova-compute[72810]:   <features>
Jul 31 19:01:44 user nova-compute[72810]:     <acpi/>
Jul 31 19:01:44 user nova-compute[72810]:     <apic/>
Jul 31 19:01:44 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:01:44 user nova-compute[72810]:   </features>
Jul 31 19:01:44 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:01:44 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:01:44 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:01:44 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:01:44 user nova-compute[72810]:   </clock>
Jul 31 19:01:44 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:01:44 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:01:44 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:01:44 user nova-compute[72810]:   </cpu>
Jul 31 19:01:44 user nova-compute[72810]:   <devices>
Jul 31 19:01:44 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:01:44 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:01:44 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk"/>
Jul 31 19:01:44 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:01:44 user nova-compute[72810]:     </disk>
Jul 31 19:01:44 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:01:44 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:01:44 user nova-compute[72810]:       <source dev="/dev/sdd"/>
Jul 31 19:01:44 user nova-compute[72810]:       <target dev="vdc" bus="virtio"/>
Jul 31 19:01:44 user nova-compute[72810]:       <serial>12a0fbdf-42be-4960-b16f-1725ee42bf13</serial>
Jul 31 19:01:44 user nova-compute[72810]:     </disk>
Jul 31 19:01:44 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:01:44 user nova-compute[72810]:       <mac address="fa:16:3e:a3:b7:f8"/>
Jul 31 19:01:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:01:44 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:01:44 user nova-compute[72810]:       <target dev="tapcac99b5c-b7"/>
Jul 31 19:01:44 user nova-compute[72810]:     </interface>
Jul 31 19:01:44 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:01:44 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/console.log" append="off"/>
Jul 31 19:01:44 user nova-compute[72810]:     </serial>
Jul 31 19:01:44 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:01:44 user nova-compute[72810]:     <video>
Jul 31 19:01:44 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:01:44 user nova-compute[72810]:     </video>
Jul 31 19:01:44 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:01:44 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:01:44 user nova-compute[72810]:     </rng>
Jul 31 19:01:44 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:01:44 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:01:44 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:01:44 user nova-compute[72810]:     </memballoon>
Jul 31 19:01:44 user nova-compute[72810]:   </devices>
Jul 31 19:01:44 user nova-compute[72810]: </domain>
Jul 31 19:01:44 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1934194688',keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T18:59:39.582726',shelved_host='user',shelved_image_id='6f6204d8-7b7e-4f0f-a6d6-f9ed9840c65f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG os_vif [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcac99b5c-b7, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcac99b5c-b7, col_values=(('external_ids', {'iface-id': 'cac99b5c-b78f-499d-8a23-d73c76d3729f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b7:f8', 'vm-uuid': 'd5566068-a0b7-4c77-a73a-e30ce589fa4a'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: INFO os_vif [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7')
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No VIF found with MAC fa:16:3e:a3:b7:f8, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.006s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: INFO nova.compute.manager [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Terminating instance
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-6ec29588-7292-4d80-82d8-e9f2e0e4de59 req-0cad8821-1c43-4168-ad47-0c9e1a261c05 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-unplugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:01:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Instance destroyed successfully.
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid 8d91e596-3d85-41e7-961a-bf9105555be1 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-842845383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-842845383',id=35,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:58:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-2eloz3fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:59:59Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=8d91e596-3d85-41e7-961a-bf9105555be1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "address": "fa:16:3e:7c:ba:40", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b8eb7f-c7", "ovs_interfaceid": "59b8eb7f-c76e-4d61-a35e-cace57809ddb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_vif [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59b8eb7f-c7, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: INFO os_vif [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ba:40,bridge_name='br-int',has_traffic_filtering=True,id=59b8eb7f-c76e-4d61-a35e-cace57809ddb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b8eb7f-c7')
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnyFdhzM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:01:46 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[92131306-a825-4e55-b0aa-3e12cec45817]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[78937b1a-88f9-4d10-9cb4-9de56cb26bb9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:46 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:46 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:01:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:01:46 user nova-compute[72810]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 (non-flash)
Jul 31 19:01:46 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:01:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f41269e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5692fbf0-5ec4-4134-a0d6-a0103e2658c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c66f93-8af9-4c44-b91e-cf83e05050b8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d301c5bb-fb08-4446-89a6-41b155cb4b44]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[06740947-3b27-4c48-b167-e95731f39d3a]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49dd746-c25e-4781-9a55-685b887ac39f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1cb3f-c80a-4729-90e9-359b47a5edbc]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260]
Jul 31 19:01:46 user nova-compute[72810]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5, portal: 172.16.0.220,3260] successful.
Jul 31 19:01:46 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cda4ec83-9413-4ebe-b61e-16029089dff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ec494-d162-4029-8012-e3064e8f61c4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== disconnect_volume: return (364ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:01:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Deleting instance files /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1_del
Jul 31 19:01:46 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Deletion of /opt/stack/data/nova/instances/8d91e596-3d85-41e7-961a-bf9105555be1_del complete
Jul 31 19:01:46 user nova-compute[72810]: INFO nova.compute.manager [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Took 1.84 seconds to destroy the instance on the hypervisor.
Jul 31 19:01:46 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Acquiring lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "8d91e596-3d85-41e7-961a-bf9105555be1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] No waiting events found dispatching network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:47 user nova-compute[72810]: WARNING nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received unexpected event network-vif-plugged-59b8eb7f-c76e-4d61-a35e-cace57809ddb for instance with vm_state active and task_state deleting.
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:47 user nova-compute[72810]: WARNING nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:47 user nova-compute[72810]: DEBUG nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:47 user nova-compute[72810]: WARNING nova.compute.manager [req-654d855a-9936-4ede-be0c-73be51fee1d3 req-d753ad3a-6a26-44ee-8134-f178e3c88bb8 service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 19:01:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Took 1.49 seconds to deallocate network for instance.
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830108.3498025, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Resumed (Lifecycle Event)
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance spawned successfully.
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830108.3530667, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Started (Lifecycle Event)
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:01:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8abc3541-77b6-46d1-b1ab-f76a4185e294 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.709s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:48 user nova-compute[72810]: INFO nova.compute.manager [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Took 0.83 seconds to detach 1 volumes for instance.
Jul 31 19:01:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:49 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:01:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-c9941e82-509b-4857-a8a1-4bcd60ec0273 req-d338beb7-b74b-4fb4-b75f-e8ab127d0cde service nova] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Received event network-vif-deleted-59b8eb7f-c76e-4d61-a35e-cace57809ddb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:49 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:01:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:49 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Deleted allocations for instance 8d91e596-3d85-41e7-961a-bf9105555be1
Jul 31 19:01:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-944fbcb6-7c8e-411c-a954-04107c4511b8 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "8d91e596-3d85-41e7-961a-bf9105555be1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.609s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:01:51 user nova-compute[72810]: INFO nova.compute.claims [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Claim successful on node user
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:01:51 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:01:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.policy [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f34b3f189d98404895e910621eb25008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b43685745c647f38e100aba6098bd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:01:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Creating image(s)
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.virt.images [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.part /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Successfully created port: 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.part /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.converted" returned: 0 in 0.300s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.922s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127,backing_fmt=raw /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127,backing_fmt=raw /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk 1073741824" returned: 0 in 0.047s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "5dbf4e062d27a8cfa598d8d84119229a920b3127" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Successfully updated port: 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing instance network info cache due to event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Cannot resize image /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'migration_context' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Ensure instance console log exists: /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5154f8f-054c-47f2-bd7e-ade67e47786f req-920f2842-66f6-4051-a293-c626db8dcb0e service nova] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:01:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance network_info: |[{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start _get_guest_xml network_info=[{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T19:01:48Z,direct_url=<?>,disk_format='qcow2',id=c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8,min_disk=0,min_ram=0,name='tempest-scenario-img--253198221',owner='7b43685745c647f38e100aba6098bd4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T19:01:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:01:54 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:54 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T19:01:48Z,direct_url=<?>,disk_format='qcow2',id=c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8,min_disk=0,min_ram=0,name='tempest-scenario-img--253198221',owner='7b43685745c647f38e100aba6098bd4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T19:01:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:01:52Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'pci_devices' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:01:54 user nova-compute[72810]:   <uuid>c922b813-0ad7-4e89-b600-7fc74de9183a</uuid>
Jul 31 19:01:54 user nova-compute[72810]:   <name>instance-00000026</name>
Jul 31 19:01:54 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:01:54 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:01:54 user nova-compute[72810]:   <metadata>
Jul 31 19:01:54 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:01:54 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:name>tempest-TestMinimumBasicScenario-server-1802567646</nova:name>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:01:54</nova:creationTime>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:01:54 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:01:54 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:owner>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:user uuid="f34b3f189d98404895e910621eb25008">tempest-TestMinimumBasicScenario-3633585-project-member</nova:user>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:project uuid="7b43685745c647f38e100aba6098bd4e">tempest-TestMinimumBasicScenario-3633585</nova:project>
Jul 31 19:01:54 user nova-compute[72810]:       </nova:owner>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:root type="image" uuid="c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8"/>
Jul 31 19:01:54 user nova-compute[72810]:       <nova:ports>
Jul 31 19:01:54 user nova-compute[72810]:         <nova:port uuid="264a7682-215e-47a3-9174-4dfbe2125c72">
Jul 31 19:01:54 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 19:01:54 user nova-compute[72810]:         </nova:port>
Jul 31 19:01:54 user nova-compute[72810]:       </nova:ports>
Jul 31 19:01:54 user nova-compute[72810]:     </nova:instance>
Jul 31 19:01:54 user nova-compute[72810]:   </metadata>
Jul 31 19:01:54 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:01:54 user nova-compute[72810]:     <system>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="serial">c922b813-0ad7-4e89-b600-7fc74de9183a</entry>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="uuid">c922b813-0ad7-4e89-b600-7fc74de9183a</entry>
Jul 31 19:01:54 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:01:54 user nova-compute[72810]:     </system>
Jul 31 19:01:54 user nova-compute[72810]:   </sysinfo>
Jul 31 19:01:54 user nova-compute[72810]:   <os>
Jul 31 19:01:54 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:01:54 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:01:54 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:01:54 user nova-compute[72810]:   </os>
Jul 31 19:01:54 user nova-compute[72810]:   <features>
Jul 31 19:01:54 user nova-compute[72810]:     <acpi/>
Jul 31 19:01:54 user nova-compute[72810]:     <apic/>
Jul 31 19:01:54 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:01:54 user nova-compute[72810]:   </features>
Jul 31 19:01:54 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:01:54 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:01:54 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:01:54 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:01:54 user nova-compute[72810]:   </clock>
Jul 31 19:01:54 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:01:54 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:01:54 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:01:54 user nova-compute[72810]:   </cpu>
Jul 31 19:01:54 user nova-compute[72810]:   <devices>
Jul 31 19:01:54 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:01:54 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:01:54 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk"/>
Jul 31 19:01:54 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:01:54 user nova-compute[72810]:     </disk>
Jul 31 19:01:54 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:01:54 user nova-compute[72810]:       <mac address="fa:16:3e:72:d2:85"/>
Jul 31 19:01:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:01:54 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:01:54 user nova-compute[72810]:       <target dev="tap264a7682-21"/>
Jul 31 19:01:54 user nova-compute[72810]:     </interface>
Jul 31 19:01:54 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:01:54 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/console.log" append="off"/>
Jul 31 19:01:54 user nova-compute[72810]:     </serial>
Jul 31 19:01:54 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:01:54 user nova-compute[72810]:     <video>
Jul 31 19:01:54 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:01:54 user nova-compute[72810]:     </video>
Jul 31 19:01:54 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:01:54 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:01:54 user nova-compute[72810]:     </rng>
Jul 31 19:01:54 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:01:54 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:01:54 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:01:54 user nova-compute[72810]:     </memballoon>
Jul 31 19:01:54 user nova-compute[72810]:   </devices>
Jul 31 19:01:54 user nova-compute[72810]: </domain>
Jul 31 19:01:54 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:01:52Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG os_vif [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap264a7682-21, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap264a7682-21, col_values=(('external_ids', {'iface-id': '264a7682-215e-47a3-9174-4dfbe2125c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:d2:85', 'vm-uuid': 'c922b813-0ad7-4e89-b600-7fc74de9183a'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:54 user nova-compute[72810]: INFO os_vif [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21')
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:01:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No VIF found with MAC fa:16:3e:72:d2:85, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:55 user nova-compute[72810]: WARNING nova.compute.manager [req-df79062b-5802-44a5-b297-50e5ea347a1a req-b90369c5-0d79-45cf-9a3d-aad73b167ec3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state building and task_state spawning.
Jul 31 19:01:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830117.8705287, c922b813-0ad7-4e89-b600-7fc74de9183a => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:01:57 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] VM Resumed (Lifecycle Event)
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:01:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance spawned successfully.
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:01:57 user nova-compute[72810]: WARNING nova.compute.manager [req-0490070f-4b1d-4c75-a85e-db948c73aba0 req-37afa6ba-c77c-4777-99c5-227e851da52c service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state building and task_state spawning.
Jul 31 19:01:57 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830117.8781128, c922b813-0ad7-4e89-b600-7fc74de9183a => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:01:57 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] VM Started (Lifecycle Event)
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:01:58 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:01:58 user nova-compute[72810]: INFO nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 31 19:01:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:01:58 user nova-compute[72810]: INFO nova.compute.manager [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Took 6.64 seconds to build instance.
Jul 31 19:01:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e972e150-c06b-4e53-bdc4-380913bbf519 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.786s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:01:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:01:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:01 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830105.9980662, 8d91e596-3d85-41e7-961a-bf9105555be1 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:02:01 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] VM Stopped (Lifecycle Event)
Jul 31 19:02:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-363c31f0-239c-479b-ba06-fd6c6f9566b7 None None] [instance: 8d91e596-3d85-41e7-961a-bf9105555be1] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:02:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:02:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:02:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:02:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:02:32 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.062164306640625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance a3bc5689-d177-44f9-9cd8-d8194d711be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d5566068-a0b7-4c77-a73a-e30ce589fa4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c922b813-0ad7-4e89-b600-7fc74de9183a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:02:32 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:02:33 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:02:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:35 user nova-compute[72810]: INFO nova.compute.manager [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Terminating instance
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-unplugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-unplugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb9fc4a5-1780-4fde-b377-543532de56a4 req-504a091a-4245-4bae-9884-0d266a7df77b service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-unplugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Instance destroyed successfully.
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid 60e683d2-fe34-4191-8c7c-153fe32f5ed0 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841836347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841836347',id=32,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-ifli6bii',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:55:10Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=60e683d2-fe34-4191-8c7c-153fe32f5ed0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "f673ecf9-963d-4267-ad5d-9687bdc88600", "address": "fa:16:3e:9d:b8:87", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf673ecf9-96", "ovs_interfaceid": "f673ecf9-963d-4267-ad5d-9687bdc88600", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG os_vif [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf673ecf9-96, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:02:36 user nova-compute[72810]: INFO os_vif [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:b8:87,bridge_name='br-int',has_traffic_filtering=True,id=f673ecf9-963d-4267-ad5d-9687bdc88600,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf673ecf9-96')
Jul 31 19:02:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Deleting instance files /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0_del
Jul 31 19:02:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Deletion of /opt/stack/data/nova/instances/60e683d2-fe34-4191-8c7c-153fe32f5ed0_del complete
Jul 31 19:02:36 user nova-compute[72810]: INFO nova.compute.manager [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 19:02:36 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:02:37 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Took 0.58 seconds to deallocate network for instance.
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-e657f5ad-d17a-4782-b2f3-ff2a2e963a49 req-53122601-04da-4889-880f-89ddff9ea051 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-deleted-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:02:37 user nova-compute[72810]: INFO nova.compute.manager [req-e657f5ad-d17a-4782-b2f3-ff2a2e963a49 req-53122601-04da-4889-880f-89ddff9ea051 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Neutron deleted interface f673ecf9-963d-4267-ad5d-9687bdc88600; detaching it from the instance and deleting it from the info cache
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.network.neutron [req-e657f5ad-d17a-4782-b2f3-ff2a2e963a49 req-53122601-04da-4889-880f-89ddff9ea051 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-e657f5ad-d17a-4782-b2f3-ff2a2e963a49 req-53122601-04da-4889-880f-89ddff9ea051 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Detach interface failed, port_id=f673ecf9-963d-4267-ad5d-9687bdc88600, reason: Instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:37 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Deleted allocations for instance 60e683d2-fe34-4191-8c7c-153fe32f5ed0
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6acaa504-f952-42ad-a296-61074a5a7cd2 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:02:37 user nova-compute[72810]: WARNING nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received unexpected event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with vm_state deleted and task_state None.
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:02:37 user nova-compute[72810]: WARNING nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received unexpected event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with vm_state deleted and task_state None.
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Acquiring lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] Lock "60e683d2-fe34-4191-8c7c-153fe32f5ed0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:02:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] No waiting events found dispatching network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:02:37 user nova-compute[72810]: WARNING nova.compute.manager [req-0534f4c8-9309-49f5-9f65-fc25595dd8f7 req-b58d6912-3c22-41f5-ac7f-7c6f6aab1df0 service nova] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Received unexpected event network-vif-plugged-f673ecf9-963d-4267-ad5d-9687bdc88600 for instance with vm_state deleted and task_state None.
Jul 31 19:02:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:02:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:02:51 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830156.419612, 60e683d2-fe34-4191-8c7c-153fe32f5ed0 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:02:51 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] VM Stopped (Lifecycle Event)
Jul 31 19:02:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-67b84eea-6021-47b8-aff5-e22b83a6a905 None None] [instance: 60e683d2-fe34-4191-8c7c-153fe32f5ed0] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:02:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:02:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:03:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:03:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:18 user nova-compute[72810]: INFO nova.compute.manager [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Detaching volume 12a0fbdf-42be-4960-b16f-1725ee42bf13
Jul 31 19:03:18 user nova-compute[72810]: INFO nova.virt.block_device [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Attempting to driver detach volume 12a0fbdf-42be-4960-b16f-1725ee42bf13 from mountpoint /dev/vdc
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Attempting to detach device vdc from instance d5566068-a0b7-4c77-a73a-e30ce589fa4a from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:03:18 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:03:18 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 19:03:18 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 19:03:18 user nova-compute[72810]:   <serial>12a0fbdf-42be-4960-b16f-1725ee42bf13</serial>
Jul 31 19:03:18 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 19:03:18 user nova-compute[72810]: </disk>
Jul 31 19:03:18 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:03:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully detached device vdc from instance d5566068-a0b7-4c77-a73a-e30ce589fa4a from the persistent domain config.
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d5566068-a0b7-4c77-a73a-e30ce589fa4a from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:03:18 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:03:18 user nova-compute[72810]:   <source dev="/dev/sdd"/>
Jul 31 19:03:18 user nova-compute[72810]:   <target dev="vdc" bus="virtio"/>
Jul 31 19:03:18 user nova-compute[72810]:   <serial>12a0fbdf-42be-4960-b16f-1725ee42bf13</serial>
Jul 31 19:03:18 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 19:03:18 user nova-compute[72810]: </disk>
Jul 31 19:03:18 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690830198.9517756, d5566068-a0b7-4c77-a73a-e30ce589fa4a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 19:03:18 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully detached device vdc from instance d5566068-a0b7-4c77-a73a-e30ce589fa4a from the live domain config.
Jul 31 19:03:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ySrmatjg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:03:18 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:03:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4fa58b-b645-4cb0-902a-f86144193e82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:18 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a630df53-62eb-4641-abb9-b6e718eb2dc0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:03:19 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:03:19 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:03:19 user nova-compute[72810]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 (non-flash)
Jul 31 19:03:19 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5a7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13'): ({'sdd'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Removing single pathed devices sdd {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a95a27-35be-49ee-b5eb-e92517a0616e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4c252-03a5-4289-84f2-d435ada8deda]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flushing IO for device /dev/sdd {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163ccec-72ba-4fb6-a39a-6465a3475bb1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f537c-e58d-484b-a8d3-a75cb8064a50]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] SCSI volumes sdd have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e06081f-6530-48e5-bdb4-1e628b1a956a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[701abc99-3214-4f19-b454-6bb8a353319c]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260]
Jul 31 19:03:19 user nova-compute[72810]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13, portal: 172.16.0.220,3260] successful.
Jul 31 19:03:19 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12a0fbdf-42be-4960-b16f-1725ee42bf13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e4069b-6d05-4e10-acc7-12bceb1ee34b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] <== disconnect_volume: return (289ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:03:19 user nova-compute[72810]: DEBUG nova.objects.instance [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'flavor' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:03:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-4e555201-b500-43af-9831-a4076e3a7c48 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:26 user nova-compute[72810]: INFO nova.compute.manager [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Terminating instance
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.compute.manager [req-782228f3-baa6-4c20-8cfd-f7f6ecd73bd9 req-c8684f8a-8ce4-4092-9d00-1dc98a0ded1b service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-unplugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Instance destroyed successfully.
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.objects.instance [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid a3bc5689-d177-44f9-9cd8-d8194d711be3 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:47:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-401461270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-401461270',id=22,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:49:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-hblixc2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:51:25Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=a3bc5689-d177-44f9-9cd8-d8194d711be3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "address": "fa:16:3e:bc:d1:c4", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c35432-d4", "ovs_interfaceid": "74c35432-d41a-419a-82ba-21c35cd4b8cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_vif [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74c35432-d4, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:03:26 user nova-compute[72810]: INFO os_vif [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:d1:c4,bridge_name='br-int',has_traffic_filtering=True,id=74c35432-d41a-419a-82ba-21c35cd4b8cb,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c35432-d4')
Jul 31 19:03:26 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YvAqJalD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:03:26 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a2a7e5-fde3-4ca3-81d6-e9d23bfc4a7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde62734-a284-4596-92d2-73632a585af5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:03:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e (non-flash)
Jul 31 19:03:26 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec3131c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44708bd-cd69-47df-9099-e4f9e5c188a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e383b2a-98c0-4189-b3ef-ca15da2560f8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:03:26 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29ddfe3-80ca-4cb1-9439-1e8977e00f76]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfae2de8-e0e0-4c5d-bc92-fb11174cdd7e]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[053e0da3-ea71-4577-885a-a2b6e9a1bdab]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dbe52a-35b5-4ab6-a5c9-4d6a5d3b6b01]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260]
Jul 31 19:03:27 user nova-compute[72810]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e, portal: 172.16.0.220,3260] successful.
Jul 31 19:03:27 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b159a13f-4b04-4cf1-8664-2528b261ba7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51647ad4-053b-46bc-b9e6-aa07aca8c196]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] <== disconnect_volume: return (257ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:03:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Deleting instance files /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3_del
Jul 31 19:03:27 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Deletion of /opt/stack/data/nova/instances/a3bc5689-d177-44f9-9cd8-d8194d711be3_del complete
Jul 31 19:03:27 user nova-compute[72810]: INFO nova.compute.manager [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:03:27 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Took 0.49 seconds to deallocate network for instance.
Jul 31 19:03:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] Acquiring lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] No waiting events found dispatching network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:03:28 user nova-compute[72810]: WARNING nova.compute.manager [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received unexpected event network-vif-plugged-74c35432-d41a-419a-82ba-21c35cd4b8cb for instance with vm_state active and task_state deleting.
Jul 31 19:03:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-f99af239-9951-42f9-af12-204cba016238 req-527a3b42-281c-4e16-aa81-6e3ed97e8afe service nova] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Received event network-vif-deleted-74c35432-d41a-419a-82ba-21c35cd4b8cb {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:03:28 user nova-compute[72810]: INFO nova.compute.manager [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Took 0.76 seconds to detach 1 volumes for instance.
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:28 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Deleted allocations for instance a3bc5689-d177-44f9-9cd8-d8194d711be3
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-45c1befd-3b7d-47a9-8c15-9e02d937a564 tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "a3bc5689-d177-44f9-9cd8-d8194d711be3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:03:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:34 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:03:34 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8505MB free_disk=25.18625259399414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance d5566068-a0b7-4c77-a73a-e30ce589fa4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c922b813-0ad7-4e89-b600-7fc74de9183a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:03:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:03:36 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:03:37 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [{"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:03:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-b65fe899-461a-44ca-85eb-8fdd33ffee9d" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:03:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:03:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:03:41 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830206.8520694, a3bc5689-d177-44f9-9cd8-d8194d711be3 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:03:41 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] VM Stopped (Lifecycle Event)
Jul 31 19:03:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-f5954681-4f9e-491b-a8cb-aafb263947d2 None None] [instance: a3bc5689-d177-44f9-9cd8-d8194d711be3] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:03:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG nova.objects.instance [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:03:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:03:45 user nova-compute[72810]: INFO nova.compute.manager [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Attaching volume 48c4159a-e583-4fcb-97cc-d7418fb31534 to /dev/vdb
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b475ef82-73c4-4d2f-8d58-b58b4bb71310]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbd380-c9f8-483b-a03a-9379b5ca84db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a333d64-7828-4bc7-aed3-4ec2b53af5da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a34d3-322e-49ff-9695-6e1022e4b620]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:03:46 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:03:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035b069-507f-46a9-b093-15047d77f042]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating existing volume attachment record: c18879f5-c672-4cf4-ba18-542712ae4a81 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:03:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:03:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:03:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:03:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:03:53 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e3cc34-ce16-4428-b097-4c031dc637c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:03:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[273e4687-51a4-40c1-b254-bd07d97e16f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534] added
Jul 31 19:03:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05df5e-3deb-43c0-a53d-313b1df12dc0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a77cd80-b480-4074-bbe4-e15c67271369]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXOdyDv {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXOdyDv" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[28646fd3-ac79-4869-a6d5-40e5d06af9ae]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUXOdyDv'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7bd174-d45b-4204-b840-572ac7cae17c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf76556-910d-4f61-b13f-393b36bbbb20]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:03:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:03:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:03:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:03:53 user nova-compute[72810]: 
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d713db6-459f-410b-bfc8-fea149a3a282]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]
Jul 31 19:03:53 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.
Jul 31 19:03:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d4f67-67ed-4b29-bd30-35d0f7b72386]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e10e459-b36b-4c08-9557-d3bb7648c699]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:03:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:03:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[42027852-8b59-4c7f-86f6-96cde470a6d3]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:03:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26466356332393337', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466356332393337', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 19:03:54 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:03:54 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:03:54 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:03:54 user nova-compute[72810]:   <serial>48c4159a-e583-4fcb-97cc-d7418fb31534</serial>
Jul 31 19:03:54 user nova-compute[72810]: </disk>
Jul 31 19:03:54 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:03:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No VIF found with MAC fa:16:3e:72:d2:85, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:03:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7df60212-bb26-403a-85f0-617505ed12ac tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.058s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:03:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing instance network info cache due to event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG nova.network.neutron [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG nova.network.neutron [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated VIF entry in instance network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG nova.network.neutron [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-aad3da09-6b35-4de3-89f3-f7f718552314 req-493a0f70-6f4d-46de-bd90-794f902f47c3 service nova] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:04:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing instance network info cache due to event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated VIF entry in instance network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd5bb0ff-2740-441b-9dbe-10bc3ecf0781 req-bad06b45-13bb-4853-a044-f1a3eff96494 service nova] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:04:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:08 user nova-compute[72810]: INFO nova.compute.manager [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Rebooting instance
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:08 user nova-compute[72810]: INFO nova.compute.manager [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Terminating instance
Jul 31 19:04:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:08 user nova-compute[72810]: DEBUG nova.network.neutron [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-baa2c6ab-8974-488e-9a79-b3334543ba9b req-e1bf3e6e-a068-4ffe-9337-47ccf3dba9cd service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-unplugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:09 user nova-compute[72810]: WARNING nova.compute.manager [req-3c103464-1cbc-4ca2-807c-7df0eb37c17f req-7ef5f2eb-c55c-47c4-96f7-9c90808413c2 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state active and task_state reboot_started_hard.
Jul 31 19:04:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Instance destroyed successfully.
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.objects.instance [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'resources' on Instance uuid d5566068-a0b7-4c77-a73a-e30ce589fa4a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T18:57:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1911600020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1911600020',id=37,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPefv6bMov76QfWm4jIXUtqGj2kNw9CQutsTRR/ZCka+5tC34J6MTEcrmXgBdbECqxMwjz4tcBozwKvnnl4tNpJBpECiHuGPl8+INoH6J1+Fb/r/lEtBdgcHbRVkV7aQtA==',key_name='tempest-keypair-1934194688',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-csekzn0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=d5566068-a0b7-4c77-a73a-e30ce589fa4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "address": "fa:16:3e:a3:b7:f8", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcac99b5c-b7", "ovs_interfaceid": "cac99b5c-b78f-499d-8a23-d73c76d3729f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG os_vif [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcac99b5c-b7, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:10 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance destroyed successfully.
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'resources' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:10 user nova-compute[72810]: INFO os_vif [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b7:f8,bridge_name='br-int',has_traffic_filtering=True,id=cac99b5c-b78f-499d-8a23-d73c76d3729f,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcac99b5c-b7')
Jul 31 19:04:10 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Deleting instance files /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a_del
Jul 31 19:04:10 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Deletion of /opt/stack/data/nova/instances/d5566068-a0b7-4c77-a73a-e30ce589fa4a_del complete
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:04:09Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap264a7682-21, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:10 user nova-compute[72810]: INFO os_vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21')
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:04:10 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c156eab-21de-4dfb-b9de-9dcd1cbe5074]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: INFO nova.compute.manager [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6f8ddc-b965-4a02-a1f6-43b216521646]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc5a4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[411fc2d7-761d-4f85-afe7-041aa4052a75]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af0efac-a43c-4ad1-a09c-ecfc363a3041]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c15a6a-08e9-4d4f-952e-50f43180059f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb6d6c1-5e47-4b0b-8ba4-2ff273c37d80]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe176e61-304c-47f0-add9-94876a0f0ed3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b08358-e45a-43f5-b3c3-40d9ca056eb7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]
Jul 31 19:04:10 user nova-compute[72810]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e0ccd-6452-48dc-bb06-f4ca562b93c0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== disconnect_volume: return (270ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start _get_guest_xml network_info=[{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': 'c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c922b813-0ad7-4e89-b600-7fc74de9183a', 'attached_at': '', 'detached_at': '', 'volume_id': '48c4159a-e583-4fcb-97cc-d7418fb31534', 'serial': '48c4159a-e583-4fcb-97cc-d7418fb31534'}, 'attachment_id': 'c18879f5-c672-4cf4-ba18-542712ae4a81', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:04:10 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:04:10 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'vcpu_model' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:04:10 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:04:10 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:04:10 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[017ec02f-0ed9-46a7-8f83-0b24908df050]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:04:10 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf2662e-5d0b-4ff9-99b1-4c4d9e081bf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534] added
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5aff53-d7f0-479c-890c-70114bbda433]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b7688-5399-4d8d-986d-84ae99d584c1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXOdyDv {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wUXOdyDv" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee79fb5-5873-4e68-9b69-d2ff07b4c7a1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wUXOdyDv'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e3a1d-dd75-4a3b-9d77-765e23d15dbf]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd7f95-14d9-4247-9d3c-b009f3a1b6ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:04:10 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:04:10 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:04:10 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:04:10 user nova-compute[72810]: 
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f199aa08-a383-454a-ab97-648b9a407ca0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]
Jul 31 19:04:10 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cee33e7-44d0-4206-b4a5-64680d410e29]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e2206-ead5-4a99-a836-90fa8e38a7b7]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:04:10 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a454299-246e-4605-bb5f-151213b755ce]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:10 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Took 0.81 seconds to deallocate network for instance.
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] Acquiring lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] No waiting events found dispatching network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:11 user nova-compute[72810]: WARNING nova.compute.manager [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received unexpected event network-vif-plugged-cac99b5c-b78f-499d-8a23-d73c76d3729f for instance with vm_state deleted and task_state None.
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-73b7990d-7ab5-422c-9a1f-5499393c34d0 req-d8e3383e-d7b6-42bb-b193-197a9646ef5b service nova] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Received event network-vif-deleted-cac99b5c-b78f-499d-8a23-d73c76d3729f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:11 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Deleted allocations for instance d5566068-a0b7-4c77-a73a-e30ce589fa4a
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-8e0a3779-5590-4da2-9cc8-cef84544334c tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d5566068-a0b7-4c77-a73a-e30ce589fa4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:11 user nova-compute[72810]: WARNING nova.compute.manager [req-51e294b6-a324-46f4-b237-dd90eadeece0 req-4ce4a9f8-32a3-4bea-ba61-03d46e8a877f service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state active and task_state reboot_started_hard.
Jul 31 19:04:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26466356332393337', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466356332393337', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:04:09Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'pci_devices' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:04:11 user nova-compute[72810]:   <uuid>c922b813-0ad7-4e89-b600-7fc74de9183a</uuid>
Jul 31 19:04:11 user nova-compute[72810]:   <name>instance-00000026</name>
Jul 31 19:04:11 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:04:11 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:04:11 user nova-compute[72810]:   <metadata>
Jul 31 19:04:11 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:04:11 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:name>tempest-TestMinimumBasicScenario-server-1802567646</nova:name>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:04:10</nova:creationTime>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:04:11 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:04:11 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:owner>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:user uuid="f34b3f189d98404895e910621eb25008">tempest-TestMinimumBasicScenario-3633585-project-member</nova:user>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:project uuid="7b43685745c647f38e100aba6098bd4e">tempest-TestMinimumBasicScenario-3633585</nova:project>
Jul 31 19:04:11 user nova-compute[72810]:       </nova:owner>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:root type="image" uuid="c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8"/>
Jul 31 19:04:11 user nova-compute[72810]:       <nova:ports>
Jul 31 19:04:11 user nova-compute[72810]:         <nova:port uuid="264a7682-215e-47a3-9174-4dfbe2125c72">
Jul 31 19:04:11 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 19:04:11 user nova-compute[72810]:         </nova:port>
Jul 31 19:04:11 user nova-compute[72810]:       </nova:ports>
Jul 31 19:04:11 user nova-compute[72810]:     </nova:instance>
Jul 31 19:04:11 user nova-compute[72810]:   </metadata>
Jul 31 19:04:11 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:04:11 user nova-compute[72810]:     <system>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="serial">c922b813-0ad7-4e89-b600-7fc74de9183a</entry>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="uuid">c922b813-0ad7-4e89-b600-7fc74de9183a</entry>
Jul 31 19:04:11 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:04:11 user nova-compute[72810]:     </system>
Jul 31 19:04:11 user nova-compute[72810]:   </sysinfo>
Jul 31 19:04:11 user nova-compute[72810]:   <os>
Jul 31 19:04:11 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:04:11 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:04:11 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:04:11 user nova-compute[72810]:   </os>
Jul 31 19:04:11 user nova-compute[72810]:   <features>
Jul 31 19:04:11 user nova-compute[72810]:     <acpi/>
Jul 31 19:04:11 user nova-compute[72810]:     <apic/>
Jul 31 19:04:11 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:04:11 user nova-compute[72810]:   </features>
Jul 31 19:04:11 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:04:11 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:04:11 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:04:11 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:04:11 user nova-compute[72810]:   </clock>
Jul 31 19:04:11 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:04:11 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:04:11 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:04:11 user nova-compute[72810]:   </cpu>
Jul 31 19:04:11 user nova-compute[72810]:   <devices>
Jul 31 19:04:11 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:04:11 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:04:11 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk"/>
Jul 31 19:04:11 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:04:11 user nova-compute[72810]:     </disk>
Jul 31 19:04:11 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:04:11 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:04:11 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 19:04:11 user nova-compute[72810]:       <target dev="vdb" bus="virtio"/>
Jul 31 19:04:11 user nova-compute[72810]:       <serial>48c4159a-e583-4fcb-97cc-d7418fb31534</serial>
Jul 31 19:04:11 user nova-compute[72810]:     </disk>
Jul 31 19:04:11 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:04:11 user nova-compute[72810]:       <mac address="fa:16:3e:72:d2:85"/>
Jul 31 19:04:11 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:04:11 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:04:11 user nova-compute[72810]:       <target dev="tap264a7682-21"/>
Jul 31 19:04:11 user nova-compute[72810]:     </interface>
Jul 31 19:04:11 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:04:11 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/console.log" append="off"/>
Jul 31 19:04:11 user nova-compute[72810]:     </serial>
Jul 31 19:04:11 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:04:11 user nova-compute[72810]:     <video>
Jul 31 19:04:11 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:04:11 user nova-compute[72810]:     </video>
Jul 31 19:04:11 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:04:11 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:04:11 user nova-compute[72810]:     </rng>
Jul 31 19:04:11 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:04:11 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:04:11 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:04:11 user nova-compute[72810]:     </memballoon>
Jul 31 19:04:11 user nova-compute[72810]:   </devices>
Jul 31 19:04:11 user nova-compute[72810]: </domain>
Jul 31 19:04:11 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:11 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'trusted_certs' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 --force-share --output=json" returned: 0 in 0.185s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Cannot resize image /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'migration_context' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:04:09Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG os_vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap264a7682-21, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap264a7682-21, col_values=(('external_ids', {'iface-id': '264a7682-215e-47a3-9174-4dfbe2125c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:d2:85', 'vm-uuid': 'c922b813-0ad7-4e89-b600-7fc74de9183a'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:12 user nova-compute[72810]: INFO os_vif [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21')
Jul 31 19:04:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:13 user nova-compute[72810]: DEBUG nova.compute.manager [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:13 user nova-compute[72810]: WARNING nova.compute.manager [req-fd4c6f42-d268-4a36-b125-ef2f50535f63 req-f4de796c-6035-46bb-9b8c-6faee1ff0e20 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state active and task_state reboot_started_hard.
Jul 31 19:04:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for c922b813-0ad7-4e89-b600-7fc74de9183a due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830255.8477023, c922b813-0ad7-4e89-b600-7fc74de9183a => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:04:15 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] VM Resumed (Lifecycle Event)
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:04:15 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance rebooted successfully.
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:04:15 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830255.8488746, c922b813-0ad7-4e89-b600-7fc74de9183a => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:04:15 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] VM Started (Lifecycle Event)
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0a85719f-979c-45bf-b3e1-e5d3e922145e tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.499s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:16 user nova-compute[72810]: WARNING nova.compute.manager [req-86854041-3003-4c7c-a4c5-328b4d787bf6 req-d2082bbc-bed1-4e60-82df-6318d5feb27d service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state active and task_state None.
Jul 31 19:04:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:16 user nova-compute[72810]: INFO nova.compute.manager [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Terminating instance
Jul 31 19:04:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-unplugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] No waiting events found dispatching network-vif-unplugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-90ab2b37-26c5-479c-8bf3-de196f26e7a8 req-7383cfba-28b7-434e-aa7a-8359a9de2ab0 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-unplugged-10549b62-094e-4435-ad44-98ed4f356d4d for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Instance destroyed successfully.
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.objects.instance [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lazy-loading 'resources' on Instance uuid b65fe899-461a-44ca-85eb-8fdd33ffee9d {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T18:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1008392714',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1008392714',id=18,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T18:44:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb86a791f5464179b055746ede494239',ramdisk_id='',reservation_id='r-g0i3i1m2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-821870912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T18:46:36Z,user_data=None,user_id='ef3882653e7244108f590048754d86b3',uuid=b65fe899-461a-44ca-85eb-8fdd33ffee9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converting VIF {"id": "10549b62-094e-4435-ad44-98ed4f356d4d", "address": "fa:16:3e:8a:48:02", "network": {"id": "27c07253-e33d-4466-a408-5c109c589940", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-356767117-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb86a791f5464179b055746ede494239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10549b62-09", "ovs_interfaceid": "10549b62-094e-4435-ad44-98ed4f356d4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG os_vif [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10549b62-09, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:17 user nova-compute[72810]: INFO os_vif [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:48:02,bridge_name='br-int',has_traffic_filtering=True,id=10549b62-094e-4435-ad44-98ed4f356d4d,network=Network(27c07253-e33d-4466-a408-5c109c589940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10549b62-09')
Jul 31 19:04:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Deleting instance files /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d_del
Jul 31 19:04:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Deletion of /opt/stack/data/nova/instances/b65fe899-461a-44ca-85eb-8fdd33ffee9d_del complete
Jul 31 19:04:17 user nova-compute[72810]: INFO nova.compute.manager [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 19:04:17 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:04:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Took 0.52 seconds to deallocate network for instance.
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-f7628b62-9373-4f8f-bc13-0361b726d5d1 req-26a32623-312c-4ee1-8807-fff10c335bd1 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-deleted-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:18 user nova-compute[72810]: INFO nova.compute.manager [req-f7628b62-9373-4f8f-bc13-0361b726d5d1 req-26a32623-312c-4ee1-8807-fff10c335bd1 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Neutron deleted interface 10549b62-094e-4435-ad44-98ed4f356d4d; detaching it from the instance and deleting it from the info cache
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.network.neutron [req-f7628b62-9373-4f8f-bc13-0361b726d5d1 req-26a32623-312c-4ee1-8807-fff10c335bd1 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-f7628b62-9373-4f8f-bc13-0361b726d5d1 req-26a32623-312c-4ee1-8807-fff10c335bd1 service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Detach interface failed, port_id=10549b62-094e-4435-ad44-98ed4f356d4d, reason: Instance b65fe899-461a-44ca-85eb-8fdd33ffee9d could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:18 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Deleted allocations for instance b65fe899-461a-44ca-85eb-8fdd33ffee9d
Jul 31 19:04:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-72d6fea1-fd85-44e5-a9f6-c4c3f6d88e2a tempest-ServerBootFromVolumeStableRescueTest-821870912 tempest-ServerBootFromVolumeStableRescueTest-821870912-project-member] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.704s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:04:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] Acquiring lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] Lock "b65fe899-461a-44ca-85eb-8fdd33ffee9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] No waiting events found dispatching network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:04:19 user nova-compute[72810]: WARNING nova.compute.manager [req-84e44b73-75e6-4b1c-af7f-7fd25f27e42c req-54649a1c-35d2-44fe-a82d-aad7ba8e64eb service nova] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Received unexpected event network-vif-plugged-10549b62-094e-4435-ad44-98ed4f356d4d for instance with vm_state deleted and task_state None.
Jul 31 19:04:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:24 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830249.95881, d5566068-a0b7-4c77-a73a-e30ce589fa4a => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:04:24 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] VM Stopped (Lifecycle Event)
Jul 31 19:04:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-db0e89c7-ef4d-46c5-91d7-00aa7310e510 None None] [instance: d5566068-a0b7-4c77-a73a-e30ce589fa4a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:04:30 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830257.6884444, b65fe899-461a-44ca-85eb-8fdd33ffee9d => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:04:32 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] VM Stopped (Lifecycle Event)
Jul 31 19:04:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-53404999-52cf-4f09-a426-d72980ef238f None None] [instance: b65fe899-461a-44ca-85eb-8fdd33ffee9d] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:04:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:04:33 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:04:34 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:04:34 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.3370361328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c922b813-0ad7-4e89-b600-7fc74de9183a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:04:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:04:35 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:04:38 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:04:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:04:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:04:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:04:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:04:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:04:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:04:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:05:02 user nova-compute[72810]: INFO nova.compute.claims [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Claim successful on node user
Jul 31 19:05:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:05:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:05:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.policy [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '145454abe36e4eb990a0431c1bcebc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e7dddc0de04feb9cc40460f2f5fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:05:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Creating image(s)
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.128s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.141s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk 1073741824" returned: 0 in 0.047s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.127s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Cannot resize image /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'migration_context' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Ensure instance console log exists: /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Successfully created port: 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Successfully updated port: 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing instance network info cache due to event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:05:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.neutron [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance network_info: |[{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start _get_guest_xml network_info=[{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:05:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:05 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq0koTspCN8qF2zrAIQyd+Y4+a24YNRfeVxqIIvXv2ydw2E4pUXdKWX9s30Vvu9uHRhDU6ch6OAvrPjvVB8LNoVS7VK9aDtOvoAzDtDnbMT3FLOyWzRQu9vYA0E2Y0+Ig==',key_name='tempest-keypair-1287087751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.objects.instance [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_devices' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:05:05 user nova-compute[72810]:   <uuid>011b25fa-928e-46cf-8a6d-d4b9da45b065</uuid>
Jul 31 19:05:05 user nova-compute[72810]:   <name>instance-00000027</name>
Jul 31 19:05:05 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:05:05 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:05:05 user nova-compute[72810]:   <metadata>
Jul 31 19:05:05 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:05:05 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-188348448</nova:name>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:05:05</nova:creationTime>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:05:05 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:05:05 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:owner>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:user uuid="145454abe36e4eb990a0431c1bcebc43">tempest-AttachVolumeShelveTestJSON-1432800121-project-member</nova:user>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:project uuid="b7e7dddc0de04feb9cc40460f2f5fe68">tempest-AttachVolumeShelveTestJSON-1432800121</nova:project>
Jul 31 19:05:05 user nova-compute[72810]:       </nova:owner>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 19:05:05 user nova-compute[72810]:       <nova:ports>
Jul 31 19:05:05 user nova-compute[72810]:         <nova:port uuid="4a32b5db-7d20-4351-af7d-eaed6ef48945">
Jul 31 19:05:05 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 19:05:05 user nova-compute[72810]:         </nova:port>
Jul 31 19:05:05 user nova-compute[72810]:       </nova:ports>
Jul 31 19:05:05 user nova-compute[72810]:     </nova:instance>
Jul 31 19:05:05 user nova-compute[72810]:   </metadata>
Jul 31 19:05:05 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:05:05 user nova-compute[72810]:     <system>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="serial">011b25fa-928e-46cf-8a6d-d4b9da45b065</entry>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="uuid">011b25fa-928e-46cf-8a6d-d4b9da45b065</entry>
Jul 31 19:05:05 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:05:05 user nova-compute[72810]:     </system>
Jul 31 19:05:05 user nova-compute[72810]:   </sysinfo>
Jul 31 19:05:05 user nova-compute[72810]:   <os>
Jul 31 19:05:05 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:05:05 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:05:05 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:05:05 user nova-compute[72810]:   </os>
Jul 31 19:05:05 user nova-compute[72810]:   <features>
Jul 31 19:05:05 user nova-compute[72810]:     <acpi/>
Jul 31 19:05:05 user nova-compute[72810]:     <apic/>
Jul 31 19:05:05 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:05:05 user nova-compute[72810]:   </features>
Jul 31 19:05:05 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:05:05 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:05:05 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:05:05 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:05:05 user nova-compute[72810]:   </clock>
Jul 31 19:05:05 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:05:05 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:05:05 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:05:05 user nova-compute[72810]:   </cpu>
Jul 31 19:05:05 user nova-compute[72810]:   <devices>
Jul 31 19:05:05 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:05:05 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:05:05 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk"/>
Jul 31 19:05:05 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:05:05 user nova-compute[72810]:     </disk>
Jul 31 19:05:05 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:05:05 user nova-compute[72810]:       <mac address="fa:16:3e:fd:53:c0"/>
Jul 31 19:05:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:05:05 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:05:05 user nova-compute[72810]:       <target dev="tap4a32b5db-7d"/>
Jul 31 19:05:05 user nova-compute[72810]:     </interface>
Jul 31 19:05:05 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:05:05 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/console.log" append="off"/>
Jul 31 19:05:05 user nova-compute[72810]:     </serial>
Jul 31 19:05:05 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:05:05 user nova-compute[72810]:     <video>
Jul 31 19:05:05 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:05:05 user nova-compute[72810]:     </video>
Jul 31 19:05:05 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:05:05 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:05:05 user nova-compute[72810]:     </rng>
Jul 31 19:05:05 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:05:05 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:05:05 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:05:05 user nova-compute[72810]:     </memballoon>
Jul 31 19:05:05 user nova-compute[72810]:   </devices>
Jul 31 19:05:05 user nova-compute[72810]: </domain>
Jul 31 19:05:05 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq0koTspCN8qF2zrAIQyd+Y4+a24YNRfeVxqIIvXv2ydw2E4pUXdKWX9s30Vvu9uHRhDU6ch6OAvrPjvVB8LNoVS7VK9aDtOvoAzDtDnbMT3FLOyWzRQu9vYA0E2Y0+Ig==',key_name='tempest-keypair-1287087751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:05:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG os_vif [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a32b5db-7d, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a32b5db-7d, col_values=(('external_ids', {'iface-id': '4a32b5db-7d20-4351-af7d-eaed6ef48945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:53:c0', 'vm-uuid': '011b25fa-928e-46cf-8a6d-d4b9da45b065'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:05 user nova-compute[72810]: INFO os_vif [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d')
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No VIF found with MAC fa:16:3e:fd:53:c0, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated VIF entry in instance network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:05:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-717288ed-2f2f-4975-bdaf-ed249921d6b1 req-63fb4a0a-2e27-4471-bb32-0989f351743f service nova] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:05:06 user nova-compute[72810]: WARNING nova.compute.manager [req-b0cca208-981d-4423-9533-42f5007a132f req-3e60c3cf-f30f-477b-b176-12d2a0935932 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state building and task_state spawning.
Jul 31 19:05:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830308.7798092, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Resumed (Lifecycle Event)
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance spawned successfully.
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830308.7820563, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Started (Lifecycle Event)
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:05:08 user nova-compute[72810]: WARNING nova.compute.manager [req-bc5578fa-565d-4ba9-9502-e1043b18ac38 req-aba8e23e-2599-45fa-aa6f-1a03869abb63 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state building and task_state spawning.
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Took 5.79 seconds to spawn the instance on the hypervisor.
Jul 31 19:05:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:08 user nova-compute[72810]: INFO nova.compute.manager [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Took 6.30 seconds to build instance.
Jul 31 19:05:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-668260dd-e897-4207-aa35-a453168451a0 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.397s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:27 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:05:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:05:29 user nova-compute[72810]: INFO nova.compute.claims [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Claim successful on node user
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:05:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.policy [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8878f9aeaee452d9132f33438842794', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41804e2146f348cea5ebbedefa3fdfa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:05:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Creating image(s)
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "/opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "/opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "/opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:29 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk 1073741824" returned: 0 in 0.057s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Successfully created port: e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Cannot resize image /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.objects.instance [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lazy-loading 'migration_context' on Instance uuid 0337380e-a92e-44cb-b129-ad9425ddc361 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Ensure instance console log exists: /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Successfully updated port: e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquired lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-changed-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Refreshing instance network info cache due to event network-changed-e68c619e-bd56-42ed-93ab-95106489a4f9. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] Acquiring lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Updating instance_info_cache with network_info: [{"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Releasing lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Instance network_info: |[{"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] Acquired lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Refreshing network info cache for port e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Start _get_guest_xml network_info=[{"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:05:31 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:31 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1930574790',display_name='tempest-VolumesActionsTest-instance-1930574790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1930574790',id=40,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41804e2146f348cea5ebbedefa3fdfa7',ramdisk_id='',reservation_id='r-kvledcai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1129521673',owner_user_name='tempest-VolumesActionsTest-1129521673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:05:30Z,user_data=None,user_id='d8878f9aeaee452d9132f33438842794',uuid=0337380e-a92e-44cb-b129-ad9425ddc361,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converting VIF {"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.objects.instance [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lazy-loading 'pci_devices' on Instance uuid 0337380e-a92e-44cb-b129-ad9425ddc361 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:05:31 user nova-compute[72810]:   <uuid>0337380e-a92e-44cb-b129-ad9425ddc361</uuid>
Jul 31 19:05:31 user nova-compute[72810]:   <name>instance-00000028</name>
Jul 31 19:05:31 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:05:31 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:05:31 user nova-compute[72810]:   <metadata>
Jul 31 19:05:31 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:05:31 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:name>tempest-VolumesActionsTest-instance-1930574790</nova:name>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:05:31</nova:creationTime>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:05:31 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:05:31 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:owner>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:user uuid="d8878f9aeaee452d9132f33438842794">tempest-VolumesActionsTest-1129521673-project-member</nova:user>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:project uuid="41804e2146f348cea5ebbedefa3fdfa7">tempest-VolumesActionsTest-1129521673</nova:project>
Jul 31 19:05:31 user nova-compute[72810]:       </nova:owner>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 19:05:31 user nova-compute[72810]:       <nova:ports>
Jul 31 19:05:31 user nova-compute[72810]:         <nova:port uuid="e68c619e-bd56-42ed-93ab-95106489a4f9">
Jul 31 19:05:31 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 19:05:31 user nova-compute[72810]:         </nova:port>
Jul 31 19:05:31 user nova-compute[72810]:       </nova:ports>
Jul 31 19:05:31 user nova-compute[72810]:     </nova:instance>
Jul 31 19:05:31 user nova-compute[72810]:   </metadata>
Jul 31 19:05:31 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:05:31 user nova-compute[72810]:     <system>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="serial">0337380e-a92e-44cb-b129-ad9425ddc361</entry>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="uuid">0337380e-a92e-44cb-b129-ad9425ddc361</entry>
Jul 31 19:05:31 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:05:31 user nova-compute[72810]:     </system>
Jul 31 19:05:31 user nova-compute[72810]:   </sysinfo>
Jul 31 19:05:31 user nova-compute[72810]:   <os>
Jul 31 19:05:31 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:05:31 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:05:31 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:05:31 user nova-compute[72810]:   </os>
Jul 31 19:05:31 user nova-compute[72810]:   <features>
Jul 31 19:05:31 user nova-compute[72810]:     <acpi/>
Jul 31 19:05:31 user nova-compute[72810]:     <apic/>
Jul 31 19:05:31 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:05:31 user nova-compute[72810]:   </features>
Jul 31 19:05:31 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:05:31 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:05:31 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:05:31 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:05:31 user nova-compute[72810]:   </clock>
Jul 31 19:05:31 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:05:31 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:05:31 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:05:31 user nova-compute[72810]:   </cpu>
Jul 31 19:05:31 user nova-compute[72810]:   <devices>
Jul 31 19:05:31 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:05:31 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:05:31 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk"/>
Jul 31 19:05:31 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:05:31 user nova-compute[72810]:     </disk>
Jul 31 19:05:31 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:05:31 user nova-compute[72810]:       <mac address="fa:16:3e:b3:18:2b"/>
Jul 31 19:05:31 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:05:31 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:05:31 user nova-compute[72810]:       <target dev="tape68c619e-bd"/>
Jul 31 19:05:31 user nova-compute[72810]:     </interface>
Jul 31 19:05:31 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:05:31 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/console.log" append="off"/>
Jul 31 19:05:31 user nova-compute[72810]:     </serial>
Jul 31 19:05:31 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:05:31 user nova-compute[72810]:     <video>
Jul 31 19:05:31 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:05:31 user nova-compute[72810]:     </video>
Jul 31 19:05:31 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:05:31 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:05:31 user nova-compute[72810]:     </rng>
Jul 31 19:05:31 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:05:31 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:05:31 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:05:31 user nova-compute[72810]:     </memballoon>
Jul 31 19:05:31 user nova-compute[72810]:   </devices>
Jul 31 19:05:31 user nova-compute[72810]: </domain>
Jul 31 19:05:31 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1930574790',display_name='tempest-VolumesActionsTest-instance-1930574790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1930574790',id=40,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41804e2146f348cea5ebbedefa3fdfa7',ramdisk_id='',reservation_id='r-kvledcai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1129521673',owner_user_name='tempest-VolumesActionsTest-1129521673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:05:30Z,user_data=None,user_id='d8878f9aeaee452d9132f33438842794',uuid=0337380e-a92e-44cb-b129-ad9425ddc361,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converting VIF {"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG os_vif [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape68c619e-bd, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape68c619e-bd, col_values=(('external_ids', {'iface-id': 'e68c619e-bd56-42ed-93ab-95106489a4f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:18:2b', 'vm-uuid': '0337380e-a92e-44cb-b129-ad9425ddc361'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:31 user nova-compute[72810]: INFO os_vif [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd')
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] No VIF found with MAC fa:16:3e:b3:18:2b, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Updated VIF entry in instance network info cache for port e68c619e-bd56-42ed-93ab-95106489a4f9. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG nova.network.neutron [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Updating instance_info_cache with network_info: [{"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:05:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0c90474-2386-48fa-a860-0cf7956fe35a req-fd28ee9a-b57b-4d4c-a4ce-0786d6039581 service nova] Releasing lock "refresh_cache-0337380e-a92e-44cb-b129-ad9425ddc361" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:05:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] No waiting events found dispatching network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:05:33 user nova-compute[72810]: WARNING nova.compute.manager [req-9ebea335-9308-4e0a-ad43-84947356a298 req-ba755784-ce3c-4d76-9a8d-2b60ce71f81b service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received unexpected event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 for instance with vm_state building and task_state spawning.
Jul 31 19:05:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:05:34 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830335.1663115, 0337380e-a92e-44cb-b129-ad9425ddc361 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] VM Resumed (Lifecycle Event)
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Instance spawned successfully.
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830335.1758208, 0337380e-a92e-44cb-b129-ad9425ddc361 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] VM Started (Lifecycle Event)
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] No waiting events found dispatching network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:05:35 user nova-compute[72810]: WARNING nova.compute.manager [req-d2e76c73-1700-4c2d-a871-2580eb110a88 req-88c2d84b-6b09-4d64-be4e-8dce4aad1669 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received unexpected event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 for instance with vm_state building and task_state spawning.
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Took 5.51 seconds to spawn the instance on the hypervisor.
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:35 user nova-compute[72810]: INFO nova.compute.manager [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Took 6.28 seconds to build instance.
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-27c653cd-69f9-49af-9d49-4d759b626463 tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.396s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:05:35 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:05:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=25.3048095703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c922b813-0ad7-4e89-b600-7fc74de9183a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 011b25fa-928e-46cf-8a6d-d4b9da45b065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0337380e-a92e-44cb-b129-ad9425ddc361 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:05:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:05:39 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:05:40 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:05:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:05:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:05:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:05:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:05:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:05:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:05:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing instance network info cache due to event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated VIF entry in instance network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG nova.network.neutron [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dc95caa5-9873-4e3d-a179-16c1370344ef req-eee45915-d108-4b92-bc92-cc1dc1894a90 service nova] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing instance network info cache due to event network-changed-264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] Acquiring lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] Acquired lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Refreshing network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:01 user nova-compute[72810]: INFO nova.compute.manager [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Detaching volume 48c4159a-e583-4fcb-97cc-d7418fb31534
Jul 31 19:06:01 user nova-compute[72810]: INFO nova.virt.block_device [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Attempting to driver detach volume 48c4159a-e583-4fcb-97cc-d7418fb31534 from mountpoint /dev/vdb
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Attempting to detach device vdb from instance c922b813-0ad7-4e89-b600-7fc74de9183a from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:06:01 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:06:01 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:06:01 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:06:01 user nova-compute[72810]:   <serial>48c4159a-e583-4fcb-97cc-d7418fb31534</serial>
Jul 31 19:06:01 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 19:06:01 user nova-compute[72810]: </disk>
Jul 31 19:06:01 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:06:01 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully detached device vdb from instance c922b813-0ad7-4e89-b600-7fc74de9183a from the persistent domain config.
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c922b813-0ad7-4e89-b600-7fc74de9183a from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:06:01 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:06:01 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:06:01 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:06:01 user nova-compute[72810]:   <serial>48c4159a-e583-4fcb-97cc-d7418fb31534</serial>
Jul 31 19:06:01 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 19:06:01 user nova-compute[72810]: </disk>
Jul 31 19:06:01 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updated VIF entry in instance network info cache for port 264a7682-215e-47a3-9174-4dfbe2125c72. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [{"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5de109d5-c06b-409a-bb3b-d7fdf752fcd9 req-85e61ac2-ae4c-4521-ad4b-c526cfbf86be service nova] Releasing lock "refresh_cache-c922b813-0ad7-4e89-b600-7fc74de9183a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690830361.9674911, c922b813-0ad7-4e89-b600-7fc74de9183a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 19:06:01 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully detached device vdb from instance c922b813-0ad7-4e89-b600-7fc74de9183a from the live domain config.
Jul 31 19:06:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wUXOdyDv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:06:01 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:06:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:06:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e739e77-311e-4903-9390-12c7368968d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efcb450-125e-4af8-ab36-089c178cf108]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:06:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 (non-flash)
Jul 31 19:06:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc4b16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed1e18-3e58-49a8-8705-accbbb15fad3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1435f-b2e1-4ea2-8781-88cc781ba81c]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a56a36-dff3-421d-8a41-2c3a39fb8719]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f47716a-b7a9-4ff2-a907-bb40076d7f72]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[489d0ff1-66ec-4b36-be70-7f20a45c5b0e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4502c21-a78f-40ee-9c99-8099cd9f917c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260]
Jul 31 19:06:02 user nova-compute[72810]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534, portal: 172.16.0.220,3260] successful.
Jul 31 19:06:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c4159a-e583-4fcb-97cc-d7418fb31534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f6f0f9-0bd8-4112-9b81-1e3dcc307040]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== disconnect_volume: return (249ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:06:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:06:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-2f5624cd-dca4-4662-97b7-d79f17f82671 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:06:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 0337380e-a92e-44cb-b129-ad9425ddc361 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:29 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:29 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:06:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:06:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:06:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:06:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:06:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.27578353881836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c922b813-0ad7-4e89-b600-7fc74de9183a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 011b25fa-928e-46cf-8a6d-d4b9da45b065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 0337380e-a92e-44cb-b129-ad9425ddc361 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:06:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:06:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:06:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:06:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:06:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:06:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing instance network info cache due to event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:06:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:06:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:06:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:06:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated VIF entry in instance network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:06:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9353c1b9-2666-4404-b7ff-82c98e2df37c req-9f9811b9-a1f3-49f3-8a7e-a9b676a8f4d1 service nova] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:56 user nova-compute[72810]: INFO nova.compute.manager [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Terminating instance
Jul 31 19:06:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:06:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-b261daa7-95b5-4a21-a577-d6a57109fdd4 req-757a7f68-9a08-4559-b594-b9d3bd77043a service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-unplugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:06:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Instance destroyed successfully.
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'resources' on Instance uuid c922b813-0ad7-4e89-b600-7fc74de9183a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:01:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1802567646',display_name='tempest-TestMinimumBasicScenario-server-1802567646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1802567646',id=38,image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPH7qLE8Oqn+rTQrG6VZwVDfbjB4//sPFJI2hQkD8hOHcieepH0ZRuNWPJNFWFmlNheI9GrhUW8TrxwD++h71muErGgmcfhLMC6p0XldWIrhoYgjezEumSfzQmAJLHZ+qw==',key_name='tempest-TestMinimumBasicScenario-812952336',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-kb7vpbgf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7ae9023-bde6-4d4e-b8c0-04095d5b9ab8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:04:16Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c922b813-0ad7-4e89-b600-7fc74de9183a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "264a7682-215e-47a3-9174-4dfbe2125c72", "address": "fa:16:3e:72:d2:85", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap264a7682-21", "ovs_interfaceid": "264a7682-215e-47a3-9174-4dfbe2125c72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG os_vif [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap264a7682-21, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:06:57 user nova-compute[72810]: INFO os_vif [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d2:85,bridge_name='br-int',has_traffic_filtering=True,id=264a7682-215e-47a3-9174-4dfbe2125c72,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap264a7682-21')
Jul 31 19:06:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Deleting instance files /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a_del
Jul 31 19:06:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Deletion of /opt/stack/data/nova/instances/c922b813-0ad7-4e89-b600-7fc74de9183a_del complete
Jul 31 19:06:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:57 user nova-compute[72810]: INFO nova.compute.manager [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 31 19:06:57 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:06:57 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:58 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Took 0.89 seconds to deallocate network for instance.
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-38efcc98-8ff8-4ab6-bb37-5c41f47bdad9 req-be9897c9-3157-476c-ae3e-6e330e8434c5 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-deleted-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:58 user nova-compute[72810]: INFO nova.compute.manager [req-38efcc98-8ff8-4ab6-bb37-5c41f47bdad9 req-be9897c9-3157-476c-ae3e-6e330e8434c5 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Neutron deleted interface 264a7682-215e-47a3-9174-4dfbe2125c72; detaching it from the instance and deleting it from the info cache
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-38efcc98-8ff8-4ab6-bb37-5c41f47bdad9 req-be9897c9-3157-476c-ae3e-6e330e8434c5 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-38efcc98-8ff8-4ab6-bb37-5c41f47bdad9 req-be9897c9-3157-476c-ae3e-6e330e8434c5 service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Detach interface failed, port_id=264a7682-215e-47a3-9174-4dfbe2125c72, reason: Instance c922b813-0ad7-4e89-b600-7fc74de9183a could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:58 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Deleted allocations for instance c922b813-0ad7-4e89-b600-7fc74de9183a
Jul 31 19:06:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-594a5503-7403-44c4-a92b-aa491a432c0f tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] Acquiring lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] Lock "c922b813-0ad7-4e89-b600-7fc74de9183a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] No waiting events found dispatching network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:06:58 user nova-compute[72810]: WARNING nova.compute.manager [req-60d2ab26-3240-42bd-ab27-5e8976eec158 req-c7078427-3d01-4709-94bb-e38087e8cbbf service nova] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Received unexpected event network-vif-plugged-264a7682-215e-47a3-9174-4dfbe2125c72 for instance with vm_state deleted and task_state None.
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:59 user nova-compute[72810]: INFO nova.compute.manager [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Shelving
Jul 31 19:06:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:06:59 user nova-compute[72810]: WARNING nova.compute.manager [req-8f2f32d2-f334-46bc-8251-9621404cd963 req-b5ce86bd-2fe8-443e-bd6b-b14f326521c0 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state active and task_state shelving.
Jul 31 19:06:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance destroyed successfully.
Jul 31 19:06:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Beginning cold snapshot process
Jul 31 19:06:59 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:06:59 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk /opt/stack/data/nova/instances/snapshots/tmp3rdaelx2/c9c53f1770d2427788b72983bccf7621 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:00 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk /opt/stack/data/nova/instances/snapshots/tmp3rdaelx2/c9c53f1770d2427788b72983bccf7621" returned: 0 in 0.495s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:00 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Snapshot extracted, beginning image upload
Jul 31 19:07:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:07:01 user nova-compute[72810]: WARNING nova.compute.manager [req-f0f3d7a3-c526-4f3f-a581-b00c383c1588 req-d6049d52-60fa-4e63-873a-369d4d599ddb service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 19:07:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Snapshot image upload complete
Jul 31 19:07:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:02 user nova-compute[72810]: INFO nova.compute.manager [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Shelve offloading
Jul 31 19:07:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance destroyed successfully.
Jul 31 19:07:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:07:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:07:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance destroyed successfully.
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'resources' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq0koTspCN8qF2zrAIQyd+Y4+a24YNRfeVxqIIvXv2ydw2E4pUXdKWX9s30Vvu9uHRhDU6ch6OAvrPjvVB8LNoVS7VK9aDtOvoAzDtDnbMT3FLOyWzRQu9vYA0E2Y0+Ig==',key_name='tempest-keypair-1287087751',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T19:07:02.703982',shelved_host='user',shelved_image_id='8a702ddb-bbf3-443e-9e5c-4a53784a4971'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG os_vif [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a32b5db-7d, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing instance network info cache due to event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.network.neutron [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:03 user nova-compute[72810]: INFO os_vif [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d')
Jul 31 19:07:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Deleting instance files /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065_del
Jul 31 19:07:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Deletion of /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065_del complete
Jul 31 19:07:03 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Deleted allocations for instance 011b25fa-928e-46cf-8a6d-d4b9da45b065
Jul 31 19:07:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'numa_topology' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-462eca73-15cf-4b92-8fe8-15e699fde7d7 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.094s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated VIF entry in instance network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-0588d344-58c3-4521-8b1b-1e5aee584366 req-f4c84f01-ea82-4a35-992a-76e455257ebd service nova] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:07:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:12 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830417.2129855, c922b813-0ad7-4e89-b600-7fc74de9183a => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:07:12 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] VM Stopped (Lifecycle Event)
Jul 31 19:07:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0babe080-55d9-4ede-a18a-a8b6afb46330 None None] [instance: c922b813-0ad7-4e89-b600-7fc74de9183a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:14 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830419.63912, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:07:14 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Stopped (Lifecycle Event)
Jul 31 19:07:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-427352ee-eec9-4a42-823d-8b35b7ae091f None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:28 user nova-compute[72810]: INFO nova.compute.manager [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Terminating instance
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-unplugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] No waiting events found dispatching network-vif-unplugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.compute.manager [req-7b8473f1-78c9-4cef-ba22-b5099be5be8f req-64552e53-15c3-45d2-8dd3-c6d3e40f08e7 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-unplugged-e68c619e-bd56-42ed-93ab-95106489a4f9 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Instance destroyed successfully.
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lazy-loading 'resources' on Instance uuid 0337380e-a92e-44cb-b129-ad9425ddc361 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:05:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1930574790',display_name='tempest-VolumesActionsTest-instance-1930574790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1930574790',id=40,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41804e2146f348cea5ebbedefa3fdfa7',ramdisk_id='',reservation_id='r-kvledcai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1129521673',owner_user_name='tempest-VolumesActionsTest-1129521673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:05:35Z,user_data=None,user_id='d8878f9aeaee452d9132f33438842794',uuid=0337380e-a92e-44cb-b129-ad9425ddc361,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converting VIF {"id": "e68c619e-bd56-42ed-93ab-95106489a4f9", "address": "fa:16:3e:b3:18:2b", "network": {"id": "111b6120-c1e1-4850-b6c8-e48572006552", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2004006507-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41804e2146f348cea5ebbedefa3fdfa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape68c619e-bd", "ovs_interfaceid": "e68c619e-bd56-42ed-93ab-95106489a4f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG os_vif [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape68c619e-bd, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:29 user nova-compute[72810]: INFO os_vif [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:18:2b,bridge_name='br-int',has_traffic_filtering=True,id=e68c619e-bd56-42ed-93ab-95106489a4f9,network=Network(111b6120-c1e1-4850-b6c8-e48572006552),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape68c619e-bd')
Jul 31 19:07:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Deleting instance files /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361_del
Jul 31 19:07:29 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Deletion of /opt/stack/data/nova/instances/0337380e-a92e-44cb-b129-ad9425ddc361_del complete
Jul 31 19:07:29 user nova-compute[72810]: INFO nova.compute.manager [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 31 19:07:29 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-68a9085c-62a2-4abd-a3ab-1f7933895d15 req-6246b585-8c85-48e6-a612-5c1e957a0be2 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-deleted-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:29 user nova-compute[72810]: INFO nova.compute.manager [req-68a9085c-62a2-4abd-a3ab-1f7933895d15 req-6246b585-8c85-48e6-a612-5c1e957a0be2 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Neutron deleted interface e68c619e-bd56-42ed-93ab-95106489a4f9; detaching it from the instance and deleting it from the info cache
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.network.neutron [req-68a9085c-62a2-4abd-a3ab-1f7933895d15 req-6246b585-8c85-48e6-a612-5c1e957a0be2 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:29 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Took 0.87 seconds to deallocate network for instance.
Jul 31 19:07:29 user nova-compute[72810]: DEBUG nova.compute.manager [req-68a9085c-62a2-4abd-a3ab-1f7933895d15 req-6246b585-8c85-48e6-a612-5c1e957a0be2 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Detach interface failed, port_id=e68c619e-bd56-42ed-93ab-95106489a4f9, reason: Instance 0337380e-a92e-44cb-b129-ad9425ddc361 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:30 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Deleted allocations for instance 0337380e-a92e-44cb-b129-ad9425ddc361
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bf39cb04-51cd-4598-aa6a-65ef79b7c6eb tempest-VolumesActionsTest-1129521673 tempest-VolumesActionsTest-1129521673-project-member] Lock "0337380e-a92e-44cb-b129-ad9425ddc361" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.067s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] Acquiring lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] Lock "0337380e-a92e-44cb-b129-ad9425ddc361-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:30 user nova-compute[72810]: DEBUG nova.compute.manager [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] No waiting events found dispatching network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:07:30 user nova-compute[72810]: WARNING nova.compute.manager [req-8405388a-94ff-438d-a73f-fbbbfed1e39f req-ddf3b147-c96a-4780-9e9e-849ea18aae16 service nova] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Received unexpected event network-vif-plugged-e68c619e-bd56-42ed-93ab-95106489a4f9 for instance with vm_state deleted and task_state None.
Jul 31 19:07:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:07:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:36 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:07:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:07:37 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.293807983398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:07:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:07:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:07:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:07:43 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830448.9729927, 0337380e-a92e-44cb-b129-ad9425ddc361 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:07:43 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] VM Stopped (Lifecycle Event)
Jul 31 19:07:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-c4a49a87-e5d5-407b-af1c-a25381445033 None None] [instance: 0337380e-a92e-44cb-b129-ad9425ddc361] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:07:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:07:50 user nova-compute[72810]: INFO nova.compute.claims [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Claim successful on node user
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:07:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.policy [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f34b3f189d98404895e910621eb25008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b43685745c647f38e100aba6098bd4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:07:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Creating image(s)
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "/opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "/opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG nova.virt.images [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] 083757c2-81c3-4c9b-9dba-9e9794f4b621 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.part /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Successfully created port: 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.part /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.converted" returned: 0 in 0.293s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.108s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c,backing_fmt=raw /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c,backing_fmt=raw /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk 1073741824" returned: 0 in 0.199s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "1fa8200c198b547aa85da556ddd26b96ddc7e62c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Successfully updated port: 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing instance network info cache due to event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Cannot resize image /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'migration_context' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance network_info: |[{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.neutron [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Start _get_guest_xml network_info=[{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T19:07:48Z,direct_url=<?>,disk_format='qcow2',id=083757c2-81c3-4c9b-9dba-9e9794f4b621,min_disk=0,min_ram=0,name='tempest-scenario-img--142959996',owner='7b43685745c647f38e100aba6098bd4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T19:07:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '083757c2-81c3-4c9b-9dba-9e9794f4b621'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:07:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:07:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T19:07:48Z,direct_url=<?>,disk_format='qcow2',id=083757c2-81c3-4c9b-9dba-9e9794f4b621,min_disk=0,min_ram=0,name='tempest-scenario-img--142959996',owner='7b43685745c647f38e100aba6098bd4e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T19:07:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1609209509',display_name='tempest-TestMinimumBasicScenario-server-1609209509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1609209509',id=41,image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvkTp7nh1f5iEURwQ218nCd06f7khM+Fk3s9FDsq/z/JuCKEYMK81On7O+EIaH3k0cIVNZXV7EewunP+hpNCCGXsI9X3cqesWcwG9oLbmbslvKvUwkhQvFqZ8ligOw0fA==',key_name='tempest-TestMinimumBasicScenario-1309053997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-bvyzr1sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:07:51Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c0f0a51c-7ecb-4362-b042-419b25dcdee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:07:52 user nova-compute[72810]:   <uuid>c0f0a51c-7ecb-4362-b042-419b25dcdee6</uuid>
Jul 31 19:07:52 user nova-compute[72810]:   <name>instance-00000029</name>
Jul 31 19:07:52 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:07:52 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:07:52 user nova-compute[72810]:   <metadata>
Jul 31 19:07:52 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:07:52 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:name>tempest-TestMinimumBasicScenario-server-1609209509</nova:name>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:07:52</nova:creationTime>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:07:52 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:07:52 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:owner>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:user uuid="f34b3f189d98404895e910621eb25008">tempest-TestMinimumBasicScenario-3633585-project-member</nova:user>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:project uuid="7b43685745c647f38e100aba6098bd4e">tempest-TestMinimumBasicScenario-3633585</nova:project>
Jul 31 19:07:52 user nova-compute[72810]:       </nova:owner>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:root type="image" uuid="083757c2-81c3-4c9b-9dba-9e9794f4b621"/>
Jul 31 19:07:52 user nova-compute[72810]:       <nova:ports>
Jul 31 19:07:52 user nova-compute[72810]:         <nova:port uuid="46982609-66d3-4ec4-a41c-27e4f0939649">
Jul 31 19:07:52 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 19:07:52 user nova-compute[72810]:         </nova:port>
Jul 31 19:07:52 user nova-compute[72810]:       </nova:ports>
Jul 31 19:07:52 user nova-compute[72810]:     </nova:instance>
Jul 31 19:07:52 user nova-compute[72810]:   </metadata>
Jul 31 19:07:52 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:07:52 user nova-compute[72810]:     <system>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="serial">c0f0a51c-7ecb-4362-b042-419b25dcdee6</entry>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="uuid">c0f0a51c-7ecb-4362-b042-419b25dcdee6</entry>
Jul 31 19:07:52 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:07:52 user nova-compute[72810]:     </system>
Jul 31 19:07:52 user nova-compute[72810]:   </sysinfo>
Jul 31 19:07:52 user nova-compute[72810]:   <os>
Jul 31 19:07:52 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:07:52 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:07:52 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:07:52 user nova-compute[72810]:   </os>
Jul 31 19:07:52 user nova-compute[72810]:   <features>
Jul 31 19:07:52 user nova-compute[72810]:     <acpi/>
Jul 31 19:07:52 user nova-compute[72810]:     <apic/>
Jul 31 19:07:52 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:07:52 user nova-compute[72810]:   </features>
Jul 31 19:07:52 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:07:52 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:07:52 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:07:52 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:07:52 user nova-compute[72810]:   </clock>
Jul 31 19:07:52 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:07:52 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:07:52 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:07:52 user nova-compute[72810]:   </cpu>
Jul 31 19:07:52 user nova-compute[72810]:   <devices>
Jul 31 19:07:52 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:07:52 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:07:52 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk"/>
Jul 31 19:07:52 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:07:52 user nova-compute[72810]:     </disk>
Jul 31 19:07:52 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:07:52 user nova-compute[72810]:       <mac address="fa:16:3e:11:29:cd"/>
Jul 31 19:07:52 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:07:52 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:07:52 user nova-compute[72810]:       <target dev="tap46982609-66"/>
Jul 31 19:07:52 user nova-compute[72810]:     </interface>
Jul 31 19:07:52 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:07:52 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/console.log" append="off"/>
Jul 31 19:07:52 user nova-compute[72810]:     </serial>
Jul 31 19:07:52 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:07:52 user nova-compute[72810]:     <video>
Jul 31 19:07:52 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:07:52 user nova-compute[72810]:     </video>
Jul 31 19:07:52 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:07:52 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:07:52 user nova-compute[72810]:     </rng>
Jul 31 19:07:52 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:07:52 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:07:52 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:07:52 user nova-compute[72810]:     </memballoon>
Jul 31 19:07:52 user nova-compute[72810]:   </devices>
Jul 31 19:07:52 user nova-compute[72810]: </domain>
Jul 31 19:07:52 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1609209509',display_name='tempest-TestMinimumBasicScenario-server-1609209509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1609209509',id=41,image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvkTp7nh1f5iEURwQ218nCd06f7khM+Fk3s9FDsq/z/JuCKEYMK81On7O+EIaH3k0cIVNZXV7EewunP+hpNCCGXsI9X3cqesWcwG9oLbmbslvKvUwkhQvFqZ8ligOw0fA==',key_name='tempest-TestMinimumBasicScenario-1309053997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-bvyzr1sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:07:51Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c0f0a51c-7ecb-4362-b042-419b25dcdee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG os_vif [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46982609-66, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46982609-66, col_values=(('external_ids', {'iface-id': '46982609-66d3-4ec4-a41c-27e4f0939649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:29:cd', 'vm-uuid': 'c0f0a51c-7ecb-4362-b042-419b25dcdee6'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:07:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:52 user nova-compute[72810]: INFO os_vif [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66')
Jul 31 19:07:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:07:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No VIF found with MAC fa:16:3e:11:29:cd, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:07:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated VIF entry in instance network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:07:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:07:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-63c07b1e-3ad2-4ab0-afcc-a20f313aa45b req-51e16bd7-2d38-435c-a9e7-e60b45d70b9d service nova] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:07:54 user nova-compute[72810]: WARNING nova.compute.manager [req-9e8e5217-2184-49a6-a29c-99e09711d8d2 req-91705ac0-ed90-4f06-86c8-634a3209ca4e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state building and task_state spawning.
Jul 31 19:07:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830476.574886, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] VM Resumed (Lifecycle Event)
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance spawned successfully.
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830476.5761573, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] VM Started (Lifecycle Event)
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:07:56 user nova-compute[72810]: INFO nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Took 5.89 seconds to spawn the instance on the hypervisor.
Jul 31 19:07:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:07:57 user nova-compute[72810]: WARNING nova.compute.manager [req-8fa20c3c-0686-4a91-b1ae-25eb1acc0993 req-76de9263-c38d-4885-a861-3777cd511ae7 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state building and task_state spawning.
Jul 31 19:07:57 user nova-compute[72810]: INFO nova.compute.manager [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Took 6.64 seconds to build instance.
Jul 31 19:07:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-bed11a14-42bd-41d8-9e59-fe7a21c78bef tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.729s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:07:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:07:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:08:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:32 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:08:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:08:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:08:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.24291229248047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:08:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:08:41 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:42 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:08:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:08:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:08:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:08:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:51 user nova-compute[72810]: INFO nova.compute.manager [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Unshelving
Jul 31 19:08:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_requests' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'numa_topology' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:08:52 user nova-compute[72810]: INFO nova.compute.claims [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Claim successful on node user
Jul 31 19:08:52 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:52 user nova-compute[72810]: INFO nova.network.neutron [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating port 4a32b5db-7d20-4351-af7d-eaed6ef48945 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 19:08:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing instance network info cache due to event network-changed-4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:08:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Creating image(s)
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'trusted_certs' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG nova.network.neutron [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Refreshing network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.part --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG nova.virt.images [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] 8a702ddb-bbf3-443e-9e5c-4a53784a4971 was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.part /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.part /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.converted" returned: 0 in 0.232s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated VIF entry in instance network info cache for port 4a32b5db-7d20-4351-af7d-eaed6ef48945. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.380s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7be38c13-9573-4a4d-aef6-3fbeb0ce0f2a req-111dddeb-10c1-42c6-98e3-b48ac9db71bf service nova] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258,backing_fmt=raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258,backing_fmt=raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk 1073741824" returned: 0 in 0.047s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "4adcfd74cb58a033e67bc6be6ca6d47c8dba1258" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'migration_context' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Rebasing disk image.
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 -F raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 -F raw /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk" returned: 0 in 2.165s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Ensure instance console log exists: /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start _get_guest_xml network_info=[{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d94b8031b748cf6261710fbba25e9fc9',container_format='bare',created_at=2023-07-31T19:06:59Z,direct_url=<?>,disk_format='qcow2',id=8a702ddb-bbf3-443e-9e5c-4a53784a4971,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-188348448-shelved',owner='b7e7dddc0de04feb9cc40460f2f5fe68',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T19:07:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:08:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:08:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d94b8031b748cf6261710fbba25e9fc9',container_format='bare',created_at=2023-07-31T19:06:59Z,direct_url=<?>,disk_format='qcow2',id=8a702ddb-bbf3-443e-9e5c-4a53784a4971,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-188348448-shelved',owner='b7e7dddc0de04feb9cc40460f2f5fe68',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T19:07:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:08:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'vcpu_model' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='8a702ddb-bbf3-443e-9e5c-4a53784a4971',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1287087751',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T19:07:02.703982',shelved_host='user',shelved_image_id='8a702ddb-bbf3-443e-9e5c-4a53784a4971'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'pci_devices' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:08:58 user nova-compute[72810]:   <uuid>011b25fa-928e-46cf-8a6d-d4b9da45b065</uuid>
Jul 31 19:08:58 user nova-compute[72810]:   <name>instance-00000027</name>
Jul 31 19:08:58 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:08:58 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:08:58 user nova-compute[72810]:   <metadata>
Jul 31 19:08:58 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:08:58 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-188348448</nova:name>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:08:57</nova:creationTime>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:08:58 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:08:58 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:owner>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:user uuid="145454abe36e4eb990a0431c1bcebc43">tempest-AttachVolumeShelveTestJSON-1432800121-project-member</nova:user>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:project uuid="b7e7dddc0de04feb9cc40460f2f5fe68">tempest-AttachVolumeShelveTestJSON-1432800121</nova:project>
Jul 31 19:08:58 user nova-compute[72810]:       </nova:owner>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:root type="image" uuid="8a702ddb-bbf3-443e-9e5c-4a53784a4971"/>
Jul 31 19:08:58 user nova-compute[72810]:       <nova:ports>
Jul 31 19:08:58 user nova-compute[72810]:         <nova:port uuid="4a32b5db-7d20-4351-af7d-eaed6ef48945">
Jul 31 19:08:58 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 19:08:58 user nova-compute[72810]:         </nova:port>
Jul 31 19:08:58 user nova-compute[72810]:       </nova:ports>
Jul 31 19:08:58 user nova-compute[72810]:     </nova:instance>
Jul 31 19:08:58 user nova-compute[72810]:   </metadata>
Jul 31 19:08:58 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:08:58 user nova-compute[72810]:     <system>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="serial">011b25fa-928e-46cf-8a6d-d4b9da45b065</entry>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="uuid">011b25fa-928e-46cf-8a6d-d4b9da45b065</entry>
Jul 31 19:08:58 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:08:58 user nova-compute[72810]:     </system>
Jul 31 19:08:58 user nova-compute[72810]:   </sysinfo>
Jul 31 19:08:58 user nova-compute[72810]:   <os>
Jul 31 19:08:58 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:08:58 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:08:58 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:08:58 user nova-compute[72810]:   </os>
Jul 31 19:08:58 user nova-compute[72810]:   <features>
Jul 31 19:08:58 user nova-compute[72810]:     <acpi/>
Jul 31 19:08:58 user nova-compute[72810]:     <apic/>
Jul 31 19:08:58 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:08:58 user nova-compute[72810]:   </features>
Jul 31 19:08:58 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:08:58 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:08:58 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:08:58 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:08:58 user nova-compute[72810]:   </clock>
Jul 31 19:08:58 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:08:58 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:08:58 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:08:58 user nova-compute[72810]:   </cpu>
Jul 31 19:08:58 user nova-compute[72810]:   <devices>
Jul 31 19:08:58 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:08:58 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:08:58 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk"/>
Jul 31 19:08:58 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:08:58 user nova-compute[72810]:     </disk>
Jul 31 19:08:58 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:08:58 user nova-compute[72810]:       <mac address="fa:16:3e:fd:53:c0"/>
Jul 31 19:08:58 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:08:58 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:08:58 user nova-compute[72810]:       <target dev="tap4a32b5db-7d"/>
Jul 31 19:08:58 user nova-compute[72810]:     </interface>
Jul 31 19:08:58 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:08:58 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/console.log" append="off"/>
Jul 31 19:08:58 user nova-compute[72810]:     </serial>
Jul 31 19:08:58 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:08:58 user nova-compute[72810]:     <video>
Jul 31 19:08:58 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:08:58 user nova-compute[72810]:     </video>
Jul 31 19:08:58 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:08:58 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:08:58 user nova-compute[72810]:     </rng>
Jul 31 19:08:58 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:08:58 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:08:58 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:08:58 user nova-compute[72810]:     </memballoon>
Jul 31 19:08:58 user nova-compute[72810]:   </devices>
Jul 31 19:08:58 user nova-compute[72810]: </domain>
Jul 31 19:08:58 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='8a702ddb-bbf3-443e-9e5c-4a53784a4971',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1287087751',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member',shelved_at='2023-07-31T19:07:02.703982',shelved_host='user',shelved_image_id='8a702ddb-bbf3-443e-9e5c-4a53784a4971'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG os_vif [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a32b5db-7d, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a32b5db-7d, col_values=(('external_ids', {'iface-id': '4a32b5db-7d20-4351-af7d-eaed6ef48945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:53:c0', 'vm-uuid': '011b25fa-928e-46cf-8a6d-d4b9da45b065'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:58 user nova-compute[72810]: INFO os_vif [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d')
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:08:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] No VIF found with MAC fa:16:3e:fd:53:c0, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:08:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:08:59 user nova-compute[72810]: WARNING nova.compute.manager [req-473c0755-353f-4d8f-8016-1e8386e19581 req-4b729b5c-6f88-4d73-9bbc-d81f4fbc5712 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 19:09:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:09:01 user nova-compute[72810]: WARNING nova.compute.manager [req-36701fc9-783d-498b-ae74-2a8c8edb9408 req-fc27cf28-5aab-4faf-b809-7a0759c2f980 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830541.794795, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:09:01 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Resumed (Lifecycle Event)
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:09:01 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance spawned successfully.
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:09:01 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830541.7961183, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:09:01 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Started (Lifecycle Event)
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:09:01 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:09:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a997749f-5740-4925-8455-8c399a121c61 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.224s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:09:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:09:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:09:31 user nova-compute[72810]: INFO nova.compute.claims [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Claim successful on node user
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:09:31 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:09:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.policy [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb437fbfd11c4de9aaaf7125f9b65e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ca581494f40cdbf31d1555d2bd7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:09:32 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Creating image(s)
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "/opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "/opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "/opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.128s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk 1073741824" returned: 0 in 0.046s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.126s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Cannot resize image /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'migration_context' on Instance uuid 3132c34d-7727-4d0b-b0cf-bb55bf11015b {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Ensure instance console log exists: /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:32 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Successfully created port: 2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Successfully updated port: 2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquired lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-changed-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Refreshing instance network info cache due to event network-changed-2eab8729-e2ff-470e-a7b4-baa798d06e9b. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] Acquiring lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Updating instance_info_cache with network_info: [{"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Releasing lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Instance network_info: |[{"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] Acquired lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.network.neutron [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Refreshing network info cache for port 2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Start _get_guest_xml network_info=[{"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:09:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:09:33 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:09:33 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-827837155',display_name='tempest-VolumesActionsTest-instance-827837155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-827837155',id=42,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-n1lgl0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:09:32Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=3132c34d-7727-4d0b-b0cf-bb55bf11015b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'pci_devices' on Instance uuid 3132c34d-7727-4d0b-b0cf-bb55bf11015b {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:09:34 user nova-compute[72810]:   <uuid>3132c34d-7727-4d0b-b0cf-bb55bf11015b</uuid>
Jul 31 19:09:34 user nova-compute[72810]:   <name>instance-0000002a</name>
Jul 31 19:09:34 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:09:34 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:09:34 user nova-compute[72810]:   <metadata>
Jul 31 19:09:34 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:09:34 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:name>tempest-VolumesActionsTest-instance-827837155</nova:name>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:09:33</nova:creationTime>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:09:34 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:09:34 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:owner>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:user uuid="fb437fbfd11c4de9aaaf7125f9b65e46">tempest-VolumesActionsTest-1727066336-project-member</nova:user>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:project uuid="2e0ca581494f40cdbf31d1555d2bd7fb">tempest-VolumesActionsTest-1727066336</nova:project>
Jul 31 19:09:34 user nova-compute[72810]:       </nova:owner>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 19:09:34 user nova-compute[72810]:       <nova:ports>
Jul 31 19:09:34 user nova-compute[72810]:         <nova:port uuid="2eab8729-e2ff-470e-a7b4-baa798d06e9b">
Jul 31 19:09:34 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 19:09:34 user nova-compute[72810]:         </nova:port>
Jul 31 19:09:34 user nova-compute[72810]:       </nova:ports>
Jul 31 19:09:34 user nova-compute[72810]:     </nova:instance>
Jul 31 19:09:34 user nova-compute[72810]:   </metadata>
Jul 31 19:09:34 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:09:34 user nova-compute[72810]:     <system>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="serial">3132c34d-7727-4d0b-b0cf-bb55bf11015b</entry>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="uuid">3132c34d-7727-4d0b-b0cf-bb55bf11015b</entry>
Jul 31 19:09:34 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:09:34 user nova-compute[72810]:     </system>
Jul 31 19:09:34 user nova-compute[72810]:   </sysinfo>
Jul 31 19:09:34 user nova-compute[72810]:   <os>
Jul 31 19:09:34 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:09:34 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:09:34 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:09:34 user nova-compute[72810]:   </os>
Jul 31 19:09:34 user nova-compute[72810]:   <features>
Jul 31 19:09:34 user nova-compute[72810]:     <acpi/>
Jul 31 19:09:34 user nova-compute[72810]:     <apic/>
Jul 31 19:09:34 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:09:34 user nova-compute[72810]:   </features>
Jul 31 19:09:34 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:09:34 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:09:34 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:09:34 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:09:34 user nova-compute[72810]:   </clock>
Jul 31 19:09:34 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:09:34 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:09:34 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:09:34 user nova-compute[72810]:   </cpu>
Jul 31 19:09:34 user nova-compute[72810]:   <devices>
Jul 31 19:09:34 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:09:34 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:09:34 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk"/>
Jul 31 19:09:34 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:09:34 user nova-compute[72810]:     </disk>
Jul 31 19:09:34 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:09:34 user nova-compute[72810]:       <mac address="fa:16:3e:02:21:5b"/>
Jul 31 19:09:34 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:09:34 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:09:34 user nova-compute[72810]:       <target dev="tap2eab8729-e2"/>
Jul 31 19:09:34 user nova-compute[72810]:     </interface>
Jul 31 19:09:34 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:09:34 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/console.log" append="off"/>
Jul 31 19:09:34 user nova-compute[72810]:     </serial>
Jul 31 19:09:34 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:09:34 user nova-compute[72810]:     <video>
Jul 31 19:09:34 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:09:34 user nova-compute[72810]:     </video>
Jul 31 19:09:34 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:09:34 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:09:34 user nova-compute[72810]:     </rng>
Jul 31 19:09:34 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:09:34 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:09:34 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:09:34 user nova-compute[72810]:     </memballoon>
Jul 31 19:09:34 user nova-compute[72810]:   </devices>
Jul 31 19:09:34 user nova-compute[72810]: </domain>
Jul 31 19:09:34 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-827837155',display_name='tempest-VolumesActionsTest-instance-827837155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-827837155',id=42,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-n1lgl0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:09:32Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=3132c34d-7727-4d0b-b0cf-bb55bf11015b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG os_vif [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eab8729-e2, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eab8729-e2, col_values=(('external_ids', {'iface-id': '2eab8729-e2ff-470e-a7b4-baa798d06e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:21:5b', 'vm-uuid': '3132c34d-7727-4d0b-b0cf-bb55bf11015b'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:34 user nova-compute[72810]: INFO os_vif [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2')
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] No VIF found with MAC fa:16:3e:02:21:5b, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Updated VIF entry in instance network info cache for port 2eab8729-e2ff-470e-a7b4-baa798d06e9b. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG nova.network.neutron [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Updating instance_info_cache with network_info: [{"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:09:34 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-66157d1f-a47e-47a0-90d6-9506d75f3b32 req-6d1d225b-5fb9-4922-864d-fddbd150669f service nova] Releasing lock "refresh_cache-3132c34d-7727-4d0b-b0cf-bb55bf11015b" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] No waiting events found dispatching network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:09:35 user nova-compute[72810]: WARNING nova.compute.manager [req-f7db75a7-5852-408b-8693-7884daaead1f req-99c388ee-c1f2-4c90-9aa0-3185f130ff64 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received unexpected event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b for instance with vm_state building and task_state spawning.
Jul 31 19:09:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830577.5615056, 3132c34d-7727-4d0b-b0cf-bb55bf11015b => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] VM Resumed (Lifecycle Event)
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Instance spawned successfully.
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830577.5654314, 3132c34d-7727-4d0b-b0cf-bb55bf11015b => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] VM Started (Lifecycle Event)
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] No waiting events found dispatching network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:09:37 user nova-compute[72810]: WARNING nova.compute.manager [req-80262a39-2a63-4a49-9cf6-4def49be3573 req-79bb4008-eb7f-4ec7-b0cd-17c00b236353 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received unexpected event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b for instance with vm_state building and task_state spawning.
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Took 5.62 seconds to spawn the instance on the hypervisor.
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:09:37 user nova-compute[72810]: INFO nova.compute.manager [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Took 6.12 seconds to build instance.
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6edf1856-e006-4a2e-a8ab-4eed70b91394 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.217s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:09:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:09:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.205772399902344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 011b25fa-928e-46cf-8a6d-d4b9da45b065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 3132c34d-7727-4d0b-b0cf-bb55bf11015b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:09:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:09:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [{"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-011b25fa-928e-46cf-8a6d-d4b9da45b065" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:09:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG nova.objects.instance [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:09:44 user nova-compute[72810]: INFO nova.compute.manager [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Attaching volume 8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 to /dev/vdb
Jul 31 19:09:44 user nova-compute[72810]: DEBUG os_brick.utils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27ceeee-425a-4405-93d5-736a67565afb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2dfc9c-42c4-4e2d-bb9b-7045bbdc247b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9912df26-989a-479b-a423-d36af28f8eed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eafbdd8-1fb1-47ba-93fd-a191204e8f3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:09:44 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:09:44 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e559b5-0155-4c43-8c96-eb5d53100622]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG os_brick.utils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating existing volume attachment record: b3ec2d66-3436-43ca-9334-e9887aacf44c {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:09:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:09:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeyiWfuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:09:56 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:09:56 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:09:56 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3557bc-cf9b-4707-a81d-61e605a76eae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:09:56 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f01527-e45d-4e56-ad0e-40ad24f6689c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399] added
Jul 31 19:09:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45c7d00-025b-4330-bd47-4cef9562264e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2984384-7aa1-4133-b312-a728b2ec1a4c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeyiWfuQ {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KeyiWfuQ" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8598401-35ce-4f27-ada3-31af845b0320]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KeyiWfuQ'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8aabf1-444e-4fb5-93db-1a10af0b0415]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbf9f31-f081-4567-acca-36e13f9f4245]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:09:56 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:09:56 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:09:56 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:09:56 user nova-compute[72810]: 
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4765c0f-14d7-4203-8a75-5f3c5b3ca3d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260]
Jul 31 19:09:56 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260] successful.
Jul 31 19:09:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a80bd5-399c-49e6-96b6-c8eabf0dd605]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[272cd60c-3976-4e19-875f-1175a2853dab]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)
Jul 31 19:09:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)
Jul 31 19:09:56 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d752a-fc5c-488b-be2d-c95c19b82b4e]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:09:56 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeyiWfuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:09:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:09:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26166626634313733', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:09:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166626634313733', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:09:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:09:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 19:09:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:09:57 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:09:57 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:09:57 user nova-compute[72810]:   <serial>8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399</serial>
Jul 31 19:09:57 user nova-compute[72810]: </disk>
Jul 31 19:09:57 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 19:09:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:09:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:09:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] No VIF found with MAC fa:16:3e:11:29:cd, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:09:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-cc805054-bf90-4c74-a946-35821ef0d4dc tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.470s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:09:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:09:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing instance network info cache due to event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:10:00 user nova-compute[72810]: DEBUG nova.network.neutron [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:10:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated VIF entry in instance network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:10:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:10:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2cc213e2-5755-4587-9a6f-f33256707b14 req-b336f5c2-8e7b-4113-b489-cd11b40ad854 service nova] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing instance network info cache due to event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG nova.network.neutron [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:03 user nova-compute[72810]: INFO nova.compute.manager [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Rebooting instance
Jul 31 19:10:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated VIF entry in instance network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-af17c129-1c3f-41f2-9258-404b9ccb4839 req-a99c3954-2f3c-4213-8e1b-6a7168d70eda service nova] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:10:04 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:10:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:07 user nova-compute[72810]: WARNING nova.compute.manager [req-fe973e5d-499d-48bb-8680-c0213a48d83a req-6f8b99a9-f85b-4e49-817a-4ceca2288a18 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state active and task_state reboot_started.
Jul 31 19:10:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance shutdown successfully.
Jul 31 19:10:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:09 user nova-compute[72810]: WARNING nova.compute.manager [req-949ab845-12d2-423d-b348-93ab6151bb6e req-70c61877-03f1-4428-ad58-8ef93cf3374e service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state active and task_state reboot_started.
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Removed pending event for c0f0a51c-7ecb-4362-b042-419b25dcdee6 due to event {{(pid=72810) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830611.122543, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:10:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] VM Resumed (Lifecycle Event)
Jul 31 19:10:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance running successfully.
Jul 31 19:10:11 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance soft rebooted successfully.
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:10:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830611.1276264, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:10:11 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] VM Started (Lifecycle Event)
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ce6542af-22be-4444-802b-b3ac556151a0 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.201s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:11 user nova-compute[72810]: WARNING nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state active and task_state None.
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:11 user nova-compute[72810]: WARNING nova.compute.manager [req-4030951b-c6d9-48bc-8a0b-20b85972a7de req-b9439766-f944-472b-97fe-2db5db05bf8a service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state active and task_state None.
Jul 31 19:10:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:10:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:34 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:34 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:10:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:10:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=25.175758361816406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 011b25fa-928e-46cf-8a6d-d4b9da45b065 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 3132c34d-7727-4d0b-b0cf-bb55bf11015b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:10:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:41 user nova-compute[72810]: INFO nova.compute.manager [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Terminating instance
Jul 31 19:10:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.compute.manager [req-41ad1b11-9b12-4c85-859f-598256c60ff6 req-21709b8f-e542-4195-9f94-f973ff143843 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-unplugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Instance destroyed successfully.
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.objects.instance [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lazy-loading 'resources' on Instance uuid 011b25fa-928e-46cf-8a6d-d4b9da45b065 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T19:05:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-188348448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-188348448',id=39,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq0koTspCN8qF2zrAIQyd+Y4+a24YNRfeVxqIIvXv2ydw2E4pUXdKWX9s30Vvu9uHRhDU6ch6OAvrPjvVB8LNoVS7VK9aDtOvoAzDtDnbMT3FLOyWzRQu9vYA0E2Y0+Ig==',key_name='tempest-keypair-1287087751',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:09:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e7dddc0de04feb9cc40460f2f5fe68',ramdisk_id='',reservation_id='r-fpdr0ry8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1432800121',owner_user_name='tempest-AttachVolumeShelveTestJSON-1432800121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:09:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='145454abe36e4eb990a0431c1bcebc43',uuid=011b25fa-928e-46cf-8a6d-d4b9da45b065,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converting VIF {"id": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "address": "fa:16:3e:fd:53:c0", "network": {"id": "cf81b6aa-99a5-439f-9f9b-df78489c105f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-988777996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e7dddc0de04feb9cc40460f2f5fe68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a32b5db-7d", "ovs_interfaceid": "4a32b5db-7d20-4351-af7d-eaed6ef48945", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG os_vif [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a32b5db-7d, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:10:42 user nova-compute[72810]: INFO os_vif [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=4a32b5db-7d20-4351-af7d-eaed6ef48945,network=Network(cf81b6aa-99a5-439f-9f9b-df78489c105f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a32b5db-7d')
Jul 31 19:10:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Deleting instance files /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065_del
Jul 31 19:10:42 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Deletion of /opt/stack/data/nova/instances/011b25fa-928e-46cf-8a6d-d4b9da45b065_del complete
Jul 31 19:10:42 user nova-compute[72810]: INFO nova.compute.manager [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:10:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:10:43 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Took 0.80 seconds to deallocate network for instance.
Jul 31 19:10:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-2822ef1b-99ce-43a8-b0c5-33b73c303773 req-1239382c-aec4-413d-a0b2-6e967de815d5 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-deleted-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:10:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:44 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Deleted allocations for instance 011b25fa-928e-46cf-8a6d-d4b9da45b065
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-0dcb4823-e7cb-41df-a22c-283cf270c0a9 tempest-AttachVolumeShelveTestJSON-1432800121 tempest-AttachVolumeShelveTestJSON-1432800121-project-member] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] Acquiring lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] Lock "011b25fa-928e-46cf-8a6d-d4b9da45b065-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG nova.compute.manager [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] No waiting events found dispatching network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:10:44 user nova-compute[72810]: WARNING nova.compute.manager [req-54f06561-7686-4d11-9a08-75c06d9d2ecd req-475574a9-3461-4175-9e19-54928dcdacd6 service nova] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Received unexpected event network-vif-plugged-4a32b5db-7d20-4351-af7d-eaed6ef48945 for instance with vm_state deleted and task_state None.
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:10:44 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:10:45 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:10:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:10:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:10:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:10:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:10:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:10:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:10:57 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830642.5342796, 011b25fa-928e-46cf-8a6d-d4b9da45b065 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:10:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] VM Stopped (Lifecycle Event)
Jul 31 19:10:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d0b137aa-d6b2-48ba-9ef2-f3ade05fad6a None None] [instance: 011b25fa-928e-46cf-8a6d-d4b9da45b065] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:10:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:22 user nova-compute[72810]: INFO nova.compute.manager [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Terminating instance
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-unplugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] No waiting events found dispatching network-vif-unplugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-16e0a4f8-b425-4325-ae94-3d36a7f94770 req-cb7bb412-4185-4b36-98b0-863e0f890567 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-unplugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Instance destroyed successfully.
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'resources' on Instance uuid 3132c34d-7727-4d0b-b0cf-bb55bf11015b {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:09:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-827837155',display_name='tempest-VolumesActionsTest-instance-827837155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-827837155',id=42,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:09:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-n1lgl0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:09:38Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=3132c34d-7727-4d0b-b0cf-bb55bf11015b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "address": "fa:16:3e:02:21:5b", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab8729-e2", "ovs_interfaceid": "2eab8729-e2ff-470e-a7b4-baa798d06e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG os_vif [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eab8729-e2, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: INFO os_vif [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:21:5b,bridge_name='br-int',has_traffic_filtering=True,id=2eab8729-e2ff-470e-a7b4-baa798d06e9b,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab8729-e2')
Jul 31 19:11:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Deleting instance files /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b_del
Jul 31 19:11:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Deletion of /opt/stack/data/nova/instances/3132c34d-7727-4d0b-b0cf-bb55bf11015b_del complete
Jul 31 19:11:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:22 user nova-compute[72810]: INFO nova.compute.manager [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 31 19:11:22 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:11:22 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:11:23 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Took 0.54 seconds to deallocate network for instance.
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-a0942d03-ec7f-447d-a238-80862f126422 req-0d833211-c5f0-40dd-9b45-907b6e1bf784 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-deleted-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:11:23 user nova-compute[72810]: INFO nova.compute.manager [req-a0942d03-ec7f-447d-a238-80862f126422 req-0d833211-c5f0-40dd-9b45-907b6e1bf784 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Neutron deleted interface 2eab8729-e2ff-470e-a7b4-baa798d06e9b; detaching it from the instance and deleting it from the info cache
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.network.neutron [req-a0942d03-ec7f-447d-a238-80862f126422 req-0d833211-c5f0-40dd-9b45-907b6e1bf784 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.compute.manager [req-a0942d03-ec7f-447d-a238-80862f126422 req-0d833211-c5f0-40dd-9b45-907b6e1bf784 service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Detach interface failed, port_id=2eab8729-e2ff-470e-a7b4-baa798d06e9b, reason: Instance 3132c34d-7727-4d0b-b0cf-bb55bf11015b could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:11:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:23 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Deleted allocations for instance 3132c34d-7727-4d0b-b0cf-bb55bf11015b
Jul 31 19:11:23 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3b6192e7-993a-4c8d-9e10-6b42df43597d tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.554s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:11:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] Acquiring lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] Lock "3132c34d-7727-4d0b-b0cf-bb55bf11015b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] No waiting events found dispatching network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:11:24 user nova-compute[72810]: WARNING nova.compute.manager [req-12682ff4-9431-4fa4-8517-6cd44ae66f90 req-54b936cf-74f8-4b8a-a043-7513d07cb40e service nova] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Received unexpected event network-vif-plugged-2eab8729-e2ff-470e-a7b4-baa798d06e9b for instance with vm_state deleted and task_state None.
Jul 31 19:11:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:11:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:36 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830682.6194375, 3132c34d-7727-4d0b-b0cf-bb55bf11015b => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:11:37 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] VM Stopped (Lifecycle Event)
Jul 31 19:11:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-22fb2bf0-31e7-40ee-bbe7-bbfac38c8396 None None] [instance: 3132c34d-7727-4d0b-b0cf-bb55bf11015b] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:11:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:11:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:11:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:11:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.230575561523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:11:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:11:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:11:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:11:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:46 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:11:46 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:11:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:11:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:11:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing instance network info cache due to event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:11:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:11:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:11:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:11:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated VIF entry in instance network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:11:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:11:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-23cfd25b-3405-4126-89de-04a8525f133e req-ccd955df-a324-4508-9924-95553ea060e1 service nova] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing instance network info cache due to event network-changed-46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Refreshing network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:11:57 user nova-compute[72810]: INFO nova.compute.manager [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Detaching volume 8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399
Jul 31 19:11:57 user nova-compute[72810]: INFO nova.virt.block_device [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Attempting to driver detach volume 8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 from mountpoint /dev/vdb
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Attempting to detach device vdb from instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:11:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:11:57 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:11:57 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:11:57 user nova-compute[72810]:   <serial>8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399</serial>
Jul 31 19:11:57 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:11:57 user nova-compute[72810]: </disk>
Jul 31 19:11:57 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:11:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully detached device vdb from instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 from the persistent domain config.
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:11:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:11:57 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:11:57 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:11:57 user nova-compute[72810]:   <serial>8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399</serial>
Jul 31 19:11:57 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:11:57 user nova-compute[72810]: </disk>
Jul 31 19:11:57 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated VIF entry in instance network info cache for port 46982609-66d3-4ec4-a41c-27e4f0939649. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-dbc5812e-7235-4d9e-8638-a0fbe74f0b20 req-8468a9dc-a45f-41b7-9b6b-419499550f79 service nova] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690830717.9225707, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 19:11:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully detached device vdb from instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 from the live domain config.
Jul 31 19:11:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KeyiWfuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:11:57 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[08054fad-f4fd-4685-9875-cf52bbcc7f32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e31d8ba-03ff-4a1a-ba06-836821e9edbd]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)
Jul 31 19:11:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 (non-flash)
Jul 31 19:11:57 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc49af80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:11:57 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261437c-b853-4baa-9a1b-caa41e139f3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[082650a0-4fdd-4299-aba0-ff9fe7c7f8fa]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a88d0-f5f1-49ce-91da-c39b639ee369]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a660a3-b0f2-4ff1-b651-9ce5aa3dfa63]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7e788-8244-4019-8e5e-b1d81fc5b3bd]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e7e4c6-23b8-4c4b-b3fa-69e46f712ecf]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260]
Jul 31 19:11:58 user nova-compute[72810]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399, portal: 172.16.0.220,3260] successful.
Jul 31 19:11:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a25a0a5-2cff-4d97-b9d2-a9f4adaeb399 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439d081-5159-4b9f-b4cf-dfc7e2d453d4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] <== disconnect_volume: return (272ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'flavor' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:11:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a2cbbac8-81e1-47b4-baab-fd37a0bd5c16 tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:13 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:12:13 user nova-compute[72810]: INFO nova.compute.claims [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Claim successful on node user
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:12:14 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.policy [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb437fbfd11c4de9aaaf7125f9b65e46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0ca581494f40cdbf31d1555d2bd7fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:12:14 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Creating image(s)
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "/opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "/opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "/opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.129s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.128s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk 1073741824" returned: 0 in 0.049s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Successfully created port: 18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Cannot resize image /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'migration_context' on Instance uuid 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Ensure instance console log exists: /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Successfully updated port: 18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquired lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-changed-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Refreshing instance network info cache due to event network-changed-18261f71-9ecb-435d-814f-83e171027635. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] Acquiring lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:12:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updating instance_info_cache with network_info: [{"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Releasing lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Instance network_info: |[{"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] Acquired lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Refreshing network info cache for port 18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Start _get_guest_xml network_info=[{"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:12:16 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:12:16 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1926552666',display_name='tempest-VolumesActionsTest-instance-1926552666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1926552666',id=43,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-2hiwtx3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:12:14Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=44d1d5a6-631b-4333-b4cc-19b97fdf9c24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'pci_devices' on Instance uuid 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:12:16 user nova-compute[72810]:   <uuid>44d1d5a6-631b-4333-b4cc-19b97fdf9c24</uuid>
Jul 31 19:12:16 user nova-compute[72810]:   <name>instance-0000002b</name>
Jul 31 19:12:16 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:12:16 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:12:16 user nova-compute[72810]:   <metadata>
Jul 31 19:12:16 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:12:16 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:name>tempest-VolumesActionsTest-instance-1926552666</nova:name>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:12:16</nova:creationTime>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:12:16 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:12:16 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:owner>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:user uuid="fb437fbfd11c4de9aaaf7125f9b65e46">tempest-VolumesActionsTest-1727066336-project-member</nova:user>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:project uuid="2e0ca581494f40cdbf31d1555d2bd7fb">tempest-VolumesActionsTest-1727066336</nova:project>
Jul 31 19:12:16 user nova-compute[72810]:       </nova:owner>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 19:12:16 user nova-compute[72810]:       <nova:ports>
Jul 31 19:12:16 user nova-compute[72810]:         <nova:port uuid="18261f71-9ecb-435d-814f-83e171027635">
Jul 31 19:12:16 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 19:12:16 user nova-compute[72810]:         </nova:port>
Jul 31 19:12:16 user nova-compute[72810]:       </nova:ports>
Jul 31 19:12:16 user nova-compute[72810]:     </nova:instance>
Jul 31 19:12:16 user nova-compute[72810]:   </metadata>
Jul 31 19:12:16 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:12:16 user nova-compute[72810]:     <system>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="serial">44d1d5a6-631b-4333-b4cc-19b97fdf9c24</entry>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="uuid">44d1d5a6-631b-4333-b4cc-19b97fdf9c24</entry>
Jul 31 19:12:16 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:12:16 user nova-compute[72810]:     </system>
Jul 31 19:12:16 user nova-compute[72810]:   </sysinfo>
Jul 31 19:12:16 user nova-compute[72810]:   <os>
Jul 31 19:12:16 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:12:16 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:12:16 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:12:16 user nova-compute[72810]:   </os>
Jul 31 19:12:16 user nova-compute[72810]:   <features>
Jul 31 19:12:16 user nova-compute[72810]:     <acpi/>
Jul 31 19:12:16 user nova-compute[72810]:     <apic/>
Jul 31 19:12:16 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:12:16 user nova-compute[72810]:   </features>
Jul 31 19:12:16 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:12:16 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:12:16 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:12:16 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:12:16 user nova-compute[72810]:   </clock>
Jul 31 19:12:16 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:12:16 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:12:16 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:12:16 user nova-compute[72810]:   </cpu>
Jul 31 19:12:16 user nova-compute[72810]:   <devices>
Jul 31 19:12:16 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:12:16 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:12:16 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk"/>
Jul 31 19:12:16 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:12:16 user nova-compute[72810]:     </disk>
Jul 31 19:12:16 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:12:16 user nova-compute[72810]:       <mac address="fa:16:3e:7d:90:e5"/>
Jul 31 19:12:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:12:16 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:12:16 user nova-compute[72810]:       <target dev="tap18261f71-9e"/>
Jul 31 19:12:16 user nova-compute[72810]:     </interface>
Jul 31 19:12:16 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:12:16 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/console.log" append="off"/>
Jul 31 19:12:16 user nova-compute[72810]:     </serial>
Jul 31 19:12:16 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:12:16 user nova-compute[72810]:     <video>
Jul 31 19:12:16 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:12:16 user nova-compute[72810]:     </video>
Jul 31 19:12:16 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:12:16 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:12:16 user nova-compute[72810]:     </rng>
Jul 31 19:12:16 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:12:16 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:12:16 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:12:16 user nova-compute[72810]:     </memballoon>
Jul 31 19:12:16 user nova-compute[72810]:   </devices>
Jul 31 19:12:16 user nova-compute[72810]: </domain>
Jul 31 19:12:16 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1926552666',display_name='tempest-VolumesActionsTest-instance-1926552666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1926552666',id=43,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-2hiwtx3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:12:14Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=44d1d5a6-631b-4333-b4cc-19b97fdf9c24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG os_vif [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18261f71-9e, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18261f71-9e, col_values=(('external_ids', {'iface-id': '18261f71-9ecb-435d-814f-83e171027635', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:90:e5', 'vm-uuid': '44d1d5a6-631b-4333-b4cc-19b97fdf9c24'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:16 user nova-compute[72810]: INFO os_vif [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e')
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] No VIF found with MAC fa:16:3e:7d:90:e5, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updated VIF entry in instance network info cache for port 18261f71-9ecb-435d-814f-83e171027635. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG nova.network.neutron [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updating instance_info_cache with network_info: [{"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:12:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8a523db9-ebea-49a0-b775-c8e0e044bc02 req-a009e55f-211b-4645-bd2f-e8d6b081b785 service nova] Releasing lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] No waiting events found dispatching network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:12:17 user nova-compute[72810]: WARNING nova.compute.manager [req-5280a9a6-eb4e-4c84-908c-90b2a9d9e871 req-aacdbd98-0a4f-4457-8f0d-71ec606886df service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received unexpected event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 for instance with vm_state building and task_state spawning.
Jul 31 19:12:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830739.708306, 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] VM Resumed (Lifecycle Event)
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Instance spawned successfully.
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830739.7102418, 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] VM Started (Lifecycle Event)
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] No waiting events found dispatching network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:12:19 user nova-compute[72810]: WARNING nova.compute.manager [req-36376cfd-65ee-4205-9f3b-226d573c2a84 req-13915325-0a68-4911-8681-ff9c8e1eb759 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received unexpected event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 for instance with vm_state building and task_state spawning.
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Took 5.49 seconds to spawn the instance on the hypervisor.
Jul 31 19:12:19 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:12:19 user nova-compute[72810]: INFO nova.compute.manager [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Took 6.01 seconds to build instance.
Jul 31 19:12:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9453d767-ee6b-4470-aa55-957afa1e7fbe tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:12:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:12:37 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:12:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:12:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=25.192607879638672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance c0f0a51c-7ecb-4362-b042-419b25dcdee6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:12:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:12:47 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:12:48 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [{"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:12:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-c0f0a51c-7ecb-4362-b042-419b25dcdee6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:12:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:12:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:12:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:52 user nova-compute[72810]: INFO nova.compute.manager [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Terminating instance
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-7c1eb4a0-1d93-43c8-8e5e-73d6fdf1bb75 req-bb85c1ea-0d14-4128-b50f-71be6846b489 service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-unplugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:12:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Instance destroyed successfully.
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lazy-loading 'resources' on Instance uuid c0f0a51c-7ecb-4362-b042-419b25dcdee6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:07:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1609209509',display_name='tempest-TestMinimumBasicScenario-server-1609209509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1609209509',id=41,image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvkTp7nh1f5iEURwQ218nCd06f7khM+Fk3s9FDsq/z/JuCKEYMK81On7O+EIaH3k0cIVNZXV7EewunP+hpNCCGXsI9X3cqesWcwG9oLbmbslvKvUwkhQvFqZ8ligOw0fA==',key_name='tempest-TestMinimumBasicScenario-1309053997',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:07:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b43685745c647f38e100aba6098bd4e',ramdisk_id='',reservation_id='r-bvyzr1sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='083757c2-81c3-4c9b-9dba-9e9794f4b621',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-3633585',owner_user_name='tempest-TestMinimumBasicScenario-3633585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:10:11Z,user_data=None,user_id='f34b3f189d98404895e910621eb25008',uuid=c0f0a51c-7ecb-4362-b042-419b25dcdee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converting VIF {"id": "46982609-66d3-4ec4-a41c-27e4f0939649", "address": "fa:16:3e:11:29:cd", "network": {"id": "75782c03-dc97-425b-83c2-07b770be96a3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1322218608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b43685745c647f38e100aba6098bd4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46982609-66", "ovs_interfaceid": "46982609-66d3-4ec4-a41c-27e4f0939649", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG os_vif [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46982609-66, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:12:52 user nova-compute[72810]: INFO os_vif [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:29:cd,bridge_name='br-int',has_traffic_filtering=True,id=46982609-66d3-4ec4-a41c-27e4f0939649,network=Network(75782c03-dc97-425b-83c2-07b770be96a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46982609-66')
Jul 31 19:12:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Deleting instance files /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6_del
Jul 31 19:12:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Deletion of /opt/stack/data/nova/instances/c0f0a51c-7ecb-4362-b042-419b25dcdee6_del complete
Jul 31 19:12:53 user nova-compute[72810]: INFO nova.compute.manager [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 19:12:53 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:12:53 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Took 0.54 seconds to deallocate network for instance.
Jul 31 19:12:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:53 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Deleted allocations for instance c0f0a51c-7ecb-4362-b042-419b25dcdee6
Jul 31 19:12:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:12:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-af704f03-65d9-41cf-bf03-89cabeccefab tempest-TestMinimumBasicScenario-3633585 tempest-TestMinimumBasicScenario-3633585-project-member] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.746s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] Acquiring lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:12:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:12:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] Lock "c0f0a51c-7ecb-4362-b042-419b25dcdee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:12:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] No waiting events found dispatching network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:12:54 user nova-compute[72810]: WARNING nova.compute.manager [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received unexpected event network-vif-plugged-46982609-66d3-4ec4-a41c-27e4f0939649 for instance with vm_state deleted and task_state None.
Jul 31 19:12:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-1e03f968-4453-4399-8584-c750e34f6420 req-0ccbb0e2-a554-45c7-b2f4-b83c940dfd6b service nova] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Received event network-vif-deleted-46982609-66d3-4ec4-a41c-27e4f0939649 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:12:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830772.8990858, c0f0a51c-7ecb-4362-b042-419b25dcdee6 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:13:07 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] VM Stopped (Lifecycle Event)
Jul 31 19:13:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ad1c0a0f-aa42-4220-9451-29f662da7a58 None None] [instance: c0f0a51c-7ecb-4362-b042-419b25dcdee6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:13:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:13:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:13:38 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:13:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:13:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=25.217029571533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:13:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:13:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:13:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:13:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:48 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updating instance_info_cache with network_info: [{"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:13:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-44d1d5a6-631b-4333-b4cc-19b97fdf9c24" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:13:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:13:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:13:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:13:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:04 user nova-compute[72810]: INFO nova.compute.manager [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Terminating instance
Jul 31 19:14:04 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-unplugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] No waiting events found dispatching network-vif-unplugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:14:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-2d7fde77-2549-44db-87c1-81956c48d441 req-fc16452c-7f58-4df3-a8a7-a5c05fb18d62 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-unplugged-18261f71-9ecb-435d-814f-83e171027635 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Instance destroyed successfully.
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lazy-loading 'resources' on Instance uuid 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:12:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1926552666',display_name='tempest-VolumesActionsTest-instance-1926552666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1926552666',id=43,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:12:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e0ca581494f40cdbf31d1555d2bd7fb',ramdisk_id='',reservation_id='r-2hiwtx3b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1727066336',owner_user_name='tempest-VolumesActionsTest-1727066336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:12:20Z,user_data=None,user_id='fb437fbfd11c4de9aaaf7125f9b65e46',uuid=44d1d5a6-631b-4333-b4cc-19b97fdf9c24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converting VIF {"id": "18261f71-9ecb-435d-814f-83e171027635", "address": "fa:16:3e:7d:90:e5", "network": {"id": "cb68225c-c56b-42e2-9676-5ced76b13c38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-10807313-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0ca581494f40cdbf31d1555d2bd7fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18261f71-9e", "ovs_interfaceid": "18261f71-9ecb-435d-814f-83e171027635", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG os_vif [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18261f71-9e, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:05 user nova-compute[72810]: INFO os_vif [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:90:e5,bridge_name='br-int',has_traffic_filtering=True,id=18261f71-9ecb-435d-814f-83e171027635,network=Network(cb68225c-c56b-42e2-9676-5ced76b13c38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18261f71-9e')
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Deleting instance files /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24_del
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Deletion of /opt/stack/data/nova/instances/44d1d5a6-631b-4333-b4cc-19b97fdf9c24_del complete
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.compute.manager [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 19:14:05 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Took 0.53 seconds to deallocate network for instance.
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-8922505a-4f14-4145-86c3-f817b2500eb5 req-8641d9b7-5a0b-4b8b-ac54-b8bf614b35d7 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-deleted-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:14:05 user nova-compute[72810]: INFO nova.compute.manager [req-8922505a-4f14-4145-86c3-f817b2500eb5 req-8641d9b7-5a0b-4b8b-ac54-b8bf614b35d7 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Neutron deleted interface 18261f71-9ecb-435d-814f-83e171027635; detaching it from the instance and deleting it from the info cache
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.network.neutron [req-8922505a-4f14-4145-86c3-f817b2500eb5 req-8641d9b7-5a0b-4b8b-ac54-b8bf614b35d7 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-8922505a-4f14-4145-86c3-f817b2500eb5 req-8641d9b7-5a0b-4b8b-ac54-b8bf614b35d7 service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Detach interface failed, port_id=18261f71-9ecb-435d-814f-83e171027635, reason: Instance 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 could not be found. {{(pid=72810) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:05 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:06 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Deleted allocations for instance 44d1d5a6-631b-4333-b4cc-19b97fdf9c24
Jul 31 19:14:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3a1bcf83-e30a-4b93-9b94-7068b9435d19 tempest-VolumesActionsTest-1727066336 tempest-VolumesActionsTest-1727066336-project-member] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] Acquiring lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] Lock "44d1d5a6-631b-4333-b4cc-19b97fdf9c24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] No waiting events found dispatching network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:14:06 user nova-compute[72810]: WARNING nova.compute.manager [req-3b59f89f-630c-4b9b-ba9c-fa828f6b8598 req-ec91d123-a963-4184-9a1c-d6d67a108b8f service nova] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Received unexpected event network-vif-plugged-18261f71-9ecb-435d-814f-83e171027635 for instance with vm_state deleted and task_state None.
Jul 31 19:14:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:20 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690830845.2238443, 44d1d5a6-631b-4333-b4cc-19b97fdf9c24 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:14:20 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] VM Stopped (Lifecycle Event)
Jul 31 19:14:20 user nova-compute[72810]: DEBUG nova.compute.manager [None req-12ffc8e6-a8c4-44f6-9301-66889e8a7cce None None] [instance: 44d1d5a6-631b-4333-b4cc-19b97fdf9c24] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:14:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:38 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:14:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:14:39 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.282833099365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:14:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:14:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:14:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:14:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:14:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:14:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:15:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Verify base images {{(pid=72810) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c
Jul 31 19:15:06 user nova-compute[72810]: WARNING nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Removable base files: /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08 /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127 /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3 /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258 /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/475876a82ee29236f652f1b5ae962531866f3cde
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b0d86dff2ae88a894518dcc86095c9f93f53e08
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dbf4e062d27a8cfa598d8d84119229a920b3127
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c70df30b0eaf7489a9a77c9cc5a4dea5ab363e3
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4adcfd74cb58a033e67bc6be6ca6d47c8dba1258
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0a9cb139fd71d595cb8c22a906fdb9785d89aad
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/df270d5e72704ee798e3dc06a2237960249dc01c
Jul 31 19:15:06 user nova-compute[72810]: INFO nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1fa8200c198b547aa85da556ddd26b96ddc7e62c
Jul 31 19:15:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Verification complete {{(pid=72810) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Verify swap images {{(pid=72810) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 31 19:15:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.imagecache [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Verify ephemeral images {{(pid=72810) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 31 19:15:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:15:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:15:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:39 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:15:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:15:40 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.272926330566406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:15:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:15:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:46 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:46 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:46 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:15:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:15:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:15:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:15:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:15:53 user nova-compute[72810]: INFO nova.compute.claims [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Claim successful on node user
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:15:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:15:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Creating image(s)
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "/opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "/opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "/opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.policy [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1c44c8bfac8422fa73b4449e98ef553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574f7601d6c4284b868f80b504ce01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "d73e29a10613dd6377aee585693de02fdf859781" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.147s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk 1073741824" returned: 0 in 0.058s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "d73e29a10613dd6377aee585693de02fdf859781" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:15:53 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk. size=1073741824 {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Successfully created port: 704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.virt.disk.api [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Cannot resize image /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk to a smaller size. {{(pid=72810) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'migration_context' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Successfully updated port: 704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:15:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-changed-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.compute.manager [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing instance network info cache due to event network-changed-704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Instance network_info: |[{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Start _get_guest_xml network_info=[{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '0efe86ed-5b8c-473b-b5ee-c879a1eae6b6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:15:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T18:35:35Z,direct_url=<?>,disk_format='qcow2',id=0efe86ed-5b8c-473b-b5ee-c879a1eae6b6,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='eb6fcf40cb514b7ab65dc47bd4ae0fcb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T18:35:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-846473206',display_name='tempest-TestStampPattern-server-846473206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-846473206',id=44,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-k73ku66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:15:53Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=f86efd13-e201-475a-8011-fbe4eb144b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'pci_devices' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:15:55 user nova-compute[72810]:   <uuid>f86efd13-e201-475a-8011-fbe4eb144b3a</uuid>
Jul 31 19:15:55 user nova-compute[72810]:   <name>instance-0000002c</name>
Jul 31 19:15:55 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:15:55 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:15:55 user nova-compute[72810]:   <metadata>
Jul 31 19:15:55 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:15:55 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:name>tempest-TestStampPattern-server-846473206</nova:name>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:15:55</nova:creationTime>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:15:55 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:15:55 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:owner>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:user uuid="b1c44c8bfac8422fa73b4449e98ef553">tempest-TestStampPattern-1120068081-project-member</nova:user>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:project uuid="9574f7601d6c4284b868f80b504ce01e">tempest-TestStampPattern-1120068081</nova:project>
Jul 31 19:15:55 user nova-compute[72810]:       </nova:owner>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:root type="image" uuid="0efe86ed-5b8c-473b-b5ee-c879a1eae6b6"/>
Jul 31 19:15:55 user nova-compute[72810]:       <nova:ports>
Jul 31 19:15:55 user nova-compute[72810]:         <nova:port uuid="704b4638-e102-4844-8805-11c7a2f3f456">
Jul 31 19:15:55 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 19:15:55 user nova-compute[72810]:         </nova:port>
Jul 31 19:15:55 user nova-compute[72810]:       </nova:ports>
Jul 31 19:15:55 user nova-compute[72810]:     </nova:instance>
Jul 31 19:15:55 user nova-compute[72810]:   </metadata>
Jul 31 19:15:55 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:15:55 user nova-compute[72810]:     <system>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="serial">f86efd13-e201-475a-8011-fbe4eb144b3a</entry>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="uuid">f86efd13-e201-475a-8011-fbe4eb144b3a</entry>
Jul 31 19:15:55 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:15:55 user nova-compute[72810]:     </system>
Jul 31 19:15:55 user nova-compute[72810]:   </sysinfo>
Jul 31 19:15:55 user nova-compute[72810]:   <os>
Jul 31 19:15:55 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:15:55 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:15:55 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:15:55 user nova-compute[72810]:   </os>
Jul 31 19:15:55 user nova-compute[72810]:   <features>
Jul 31 19:15:55 user nova-compute[72810]:     <acpi/>
Jul 31 19:15:55 user nova-compute[72810]:     <apic/>
Jul 31 19:15:55 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:15:55 user nova-compute[72810]:   </features>
Jul 31 19:15:55 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:15:55 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:15:55 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:15:55 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:15:55 user nova-compute[72810]:   </clock>
Jul 31 19:15:55 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:15:55 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:15:55 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:15:55 user nova-compute[72810]:   </cpu>
Jul 31 19:15:55 user nova-compute[72810]:   <devices>
Jul 31 19:15:55 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:15:55 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:15:55 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk"/>
Jul 31 19:15:55 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:15:55 user nova-compute[72810]:     </disk>
Jul 31 19:15:55 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:15:55 user nova-compute[72810]:       <mac address="fa:16:3e:be:84:5e"/>
Jul 31 19:15:55 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:15:55 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:15:55 user nova-compute[72810]:       <target dev="tap704b4638-e1"/>
Jul 31 19:15:55 user nova-compute[72810]:     </interface>
Jul 31 19:15:55 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:15:55 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/console.log" append="off"/>
Jul 31 19:15:55 user nova-compute[72810]:     </serial>
Jul 31 19:15:55 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:15:55 user nova-compute[72810]:     <video>
Jul 31 19:15:55 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:15:55 user nova-compute[72810]:     </video>
Jul 31 19:15:55 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:15:55 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:15:55 user nova-compute[72810]:     </rng>
Jul 31 19:15:55 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:15:55 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:15:55 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:15:55 user nova-compute[72810]:     </memballoon>
Jul 31 19:15:55 user nova-compute[72810]:   </devices>
Jul 31 19:15:55 user nova-compute[72810]: </domain>
Jul 31 19:15:55 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-846473206',display_name='tempest-TestStampPattern-server-846473206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-846473206',id=44,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-k73ku66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:15:53Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=f86efd13-e201-475a-8011-fbe4eb144b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG os_vif [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap704b4638-e1, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap704b4638-e1, col_values=(('external_ids', {'iface-id': '704b4638-e102-4844-8805-11c7a2f3f456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:84:5e', 'vm-uuid': 'f86efd13-e201-475a-8011-fbe4eb144b3a'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:55 user nova-compute[72810]: INFO os_vif [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1')
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No VIF found with MAC fa:16:3e:be:84:5e, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated VIF entry in instance network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG nova.network.neutron [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:15:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-cd34c21c-f740-4ea3-8a87-efa8417b0379 req-232a3dbe-f302-4e3a-be0b-61e7a6138d9e service nova] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:15:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] No waiting events found dispatching network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:15:57 user nova-compute[72810]: WARNING nova.compute.manager [req-c5f8f51f-79e7-4d58-85f9-7194829d7113 req-e8371349-82a0-4fd5-a0ac-1ac264b7ccb9 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received unexpected event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 for instance with vm_state building and task_state spawning.
Jul 31 19:15:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] No waiting events found dispatching network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:15:59 user nova-compute[72810]: WARNING nova.compute.manager [req-22c32277-03d1-47e2-ad07-64f92b11f240 req-e6f1263c-5d8c-4801-87bc-827c55699813 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received unexpected event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 for instance with vm_state building and task_state spawning.
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830959.3831942, f86efd13-e201-475a-8011-fbe4eb144b3a => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] VM Resumed (Lifecycle Event)
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Instance spawned successfully.
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690830959.385313, f86efd13-e201-475a-8011-fbe4eb144b3a => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] VM Started (Lifecycle Event)
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Took 6.06 seconds to spawn the instance on the hypervisor.
Jul 31 19:15:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:15:59 user nova-compute[72810]: INFO nova.compute.manager [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Took 6.57 seconds to build instance.
Jul 31 19:15:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6db650c9-6f4d-488c-a042-844c3b371633 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.668s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:16:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:16:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:16:40 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:16:41 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:16:41 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.242721557617188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:16:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:16:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:42 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:42 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:16:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:16:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:16:51 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:16:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:16:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:16:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:16:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:16:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:17:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:17:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:17:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.24213409423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:17:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:17:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-changed-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG nova.compute.manager [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing instance network info cache due to event network-changed-704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG nova.network.neutron [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG nova.network.neutron [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated VIF entry in instance network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG nova.network.neutron [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-a403da07-d75b-40f3-a64e-934ac86ff434 req-1b8d2944-1849-4706-931c-c8c71e609868 service nova] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:17:45 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG nova.objects.instance [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:17:46 user nova-compute[72810]: INFO nova.compute.manager [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Attaching volume ad8067fb-8d87-42ae-98e7-fcda66ad2bff to /dev/vdb
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3a397-082c-4edf-a816-ab8496a1baed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[488016f1-49f5-4046-bf6e-4375a3fb2737]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab707e-7db4-4136-a378-b6bf33830194]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2b7168-c833-485a-9835-4c00ddf1e4b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:17:46 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:17:46 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d6ced2-a472-4846-8471-49ba6367b060]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG os_brick.utils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:17:46 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating existing volume attachment record: 840b3609-6608-4880-bd3b-942e42326ba0 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:17:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:17:52 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXDRzJKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:17:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:17:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:17:53 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[de41d414-76af-45fb-99f8-49d67e69428b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:17:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a38df5-111c-4f9c-b9bd-985b50712986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff] added
Jul 31 19:17:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a518756-3610-4733-a055-8babf1475f98]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3cb8f1-1df6-47d9-a754-4896ad1bab9c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXDRzJKx {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXDRzJKx" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f5057c-5ae1-4bb8-ad7c-a9e9cbfcb37e]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cXDRzJKx'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c2d9d-ae86-4612-8e9b-196eb9c652b4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668aad7-0541-4cea-bf9d-91240aec8aa5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:17:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:17:53 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:17:53 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:17:53 user nova-compute[72810]: 
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d51e7-1086-4fe8-89ee-e1fd39546c4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260]
Jul 31 19:17:53 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260] successful.
Jul 31 19:17:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52ec16-f4af-4ab5-b343-374662d7e982]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ce5e5-02e6-4f1d-8ecd-b4a768bd532a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)
Jul 31 19:17:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)
Jul 31 19:17:53 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bc1fc-e37c-4d75-98c1-451d91c50d9d]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:17:53 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXDRzJKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:17:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:17:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23461393338316330', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:17:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393338316330', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:17:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 19:17:55 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:17:55 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:17:55 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:17:55 user nova-compute[72810]:   <serial>ad8067fb-8d87-42ae-98e7-fcda66ad2bff</serial>
Jul 31 19:17:55 user nova-compute[72810]: </disk>
Jul 31 19:17:55 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No VIF found with MAC fa:16:3e:be:84:5e, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-66f8f256-c426-4d11-a58d-3f67eb20e171 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.861s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:17:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:17:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:17:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:17:57 user nova-compute[72810]: INFO nova.compute.manager [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Detaching volume ad8067fb-8d87-42ae-98e7-fcda66ad2bff
Jul 31 19:17:57 user nova-compute[72810]: INFO nova.virt.block_device [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Attempting to driver detach volume ad8067fb-8d87-42ae-98e7-fcda66ad2bff from mountpoint /dev/vdb
Jul 31 19:17:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Attempting to detach device vdb from instance f86efd13-e201-475a-8011-fbe4eb144b3a from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 19:17:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:17:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:17:57 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:17:57 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:17:57 user nova-compute[72810]:   <serial>ad8067fb-8d87-42ae-98e7-fcda66ad2bff</serial>
Jul 31 19:17:57 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:17:57 user nova-compute[72810]: </disk>
Jul 31 19:17:57 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:17:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully detached device vdb from instance f86efd13-e201-475a-8011-fbe4eb144b3a from the persistent domain config.
Jul 31 19:17:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f86efd13-e201-475a-8011-fbe4eb144b3a from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 19:17:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:17:57 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:17:57 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:17:57 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:17:57 user nova-compute[72810]:   <serial>ad8067fb-8d87-42ae-98e7-fcda66ad2bff</serial>
Jul 31 19:17:57 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:17:57 user nova-compute[72810]: </disk>
Jul 31 19:17:57 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690831078.3761642, f86efd13-e201-475a-8011-fbe4eb144b3a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 19:17:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully detached device vdb from instance f86efd13-e201-475a-8011-fbe4eb144b3a from the live domain config.
Jul 31 19:17:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXDRzJKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:17:58 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e776a-73ac-4a96-8f2b-fa57818fbde4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a500c-6883-457b-af33-31f97c8b62d2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)
Jul 31 19:17:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff (non-flash)
Jul 31 19:17:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec2156c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bafb34-08e5-40ea-98d0-16bdcfbd517f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c51cc2d-8cd7-4031-8806-29dcc775beee]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d65024-09ac-4bd1-a101-0912c2338a31]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6362e5-d92d-44df-88ba-a79d1f11bc56]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff44d1e-d414-49c0-8a1b-d695de89ad07]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[938fe733-67ae-401c-9518-e578399e2be8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260]
Jul 31 19:17:58 user nova-compute[72810]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff, portal: 172.16.0.220,3260] successful.
Jul 31 19:17:58 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8067fb-8d87-42ae-98e7-fcda66ad2bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d64ce-04a4-4a0f-8b00-55b19c8e83f7]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== disconnect_volume: return (272ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:17:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:17:59 user nova-compute[72810]: DEBUG nova.objects.instance [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:17:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-6b83202e-9f19-4c42-a7b9-788959a0bd88 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.558s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:18:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:18:41 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:18:42 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.241012573242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:18:42 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:18:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:44 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:18:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:18:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:18:53 user nova-compute[72810]: INFO nova.compute.manager [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] instance snapshotting
Jul 31 19:18:53 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Beginning live snapshot process
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json -f qcow2 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:53 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781 --force-share --output=json" returned: 0 in 0.160s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0.delta 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d73e29a10613dd6377aee585693de02fdf859781,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0.delta 1073741824" returned: 0 in 0.051s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:54 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 19:18:54 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:18:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 19:18:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72810) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 19:18:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 19:18:55 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:18:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0.delta /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:18:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:18:56 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0.delta /opt/stack/data/nova/instances/snapshots/tmplekskjxv/329cdb4185e04ca5bf37c5375a7b08d0" returned: 0 in 0.578s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:18:56 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Snapshot extracted, beginning image upload
Jul 31 19:18:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:18:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Snapshot image upload complete
Jul 31 19:18:58 user nova-compute[72810]: INFO nova.compute.manager [None req-566789a1-fb88-43ec-9af2-2a0cdf6b8b44 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Took 5.26 seconds to snapshot the instance on the hypervisor.
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:19:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:19:01 user nova-compute[72810]: INFO nova.compute.claims [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Claim successful on node user
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:19:01 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.policy [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1c44c8bfac8422fa73b4449e98ef553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574f7601d6c4284b868f80b504ce01e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:19:01 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Creating image(s)
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "/opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "/opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.part --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Successfully created port: 3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.part --force-share --output=json" returned: 0 in 0.132s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG nova.virt.images [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] 37148163-4854-4163-9516-2f7763bb40dc was qcow2, converting to raw {{(pid=72810) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG nova.privsep.utils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72810) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 19:19:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.part /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.converted {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.part /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.converted" returned: 0 in 0.998s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.converted --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Successfully updated port: 3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquired lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.027s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing instance network info cache due to event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] Acquiring lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json" returned: 0 in 0.131s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf,backing_fmt=raw /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk 1073741824 {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf,backing_fmt=raw /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk 1073741824" returned: 0 in 0.051s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "8dc046842994c23ca990f0c4a60c76b49306c1cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8dc046842994c23ca990f0c4a60c76b49306c1cf --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'migration_context' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Releasing lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Instance network_info: |[{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] Acquired lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Created local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Ensure instance console log exists: /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Start _get_guest_xml network_info=[{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ce99732a3112bc5575dc36d8fd48a086',container_format='bare',created_at=2023-07-31T19:18:53Z,direct_url=<?>,disk_format='qcow2',id=37148163-4854-4163-9516-2f7763bb40dc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1596154634',owner='9574f7601d6c4284b868f80b504ce01e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T19:18:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'image_id': '37148163-4854-4163-9516-2f7763bb40dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:19:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:19:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ce99732a3112bc5575dc36d8fd48a086',container_format='bare',created_at=2023-07-31T19:18:53Z,direct_url=<?>,disk_format='qcow2',id=37148163-4854-4163-9516-2f7763bb40dc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1596154634',owner='9574f7601d6c4284b868f80b504ce01e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T19:18:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564134153',display_name='tempest-TestStampPattern-server-1564134153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564134153',id=45,image_ref='37148163-4854-4163-9516-2f7763bb40dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-7oycccxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f86efd13-e201-475a-8011-fbe4eb144b3a',image_min_disk='1',image_min_ram='0',image_owner_id='9574f7601d6c4284b868f80b504ce01e',image_owner_project_name='tempest-TestStampPattern-1120068081',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1120068081-project-member',image_user_id='b1c44c8bfac8422fa73b4449e98ef553',network_allocated='True',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:19:02Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=9e60b1bd-1f5e-4451-8d42-c6ee55483083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.objects.instance [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:19:04 user nova-compute[72810]:   <uuid>9e60b1bd-1f5e-4451-8d42-c6ee55483083</uuid>
Jul 31 19:19:04 user nova-compute[72810]:   <name>instance-0000002d</name>
Jul 31 19:19:04 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:19:04 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:19:04 user nova-compute[72810]:   <metadata>
Jul 31 19:19:04 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:19:04 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:name>tempest-TestStampPattern-server-1564134153</nova:name>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:19:04</nova:creationTime>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:19:04 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:19:04 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:owner>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:user uuid="b1c44c8bfac8422fa73b4449e98ef553">tempest-TestStampPattern-1120068081-project-member</nova:user>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:project uuid="9574f7601d6c4284b868f80b504ce01e">tempest-TestStampPattern-1120068081</nova:project>
Jul 31 19:19:04 user nova-compute[72810]:       </nova:owner>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:root type="image" uuid="37148163-4854-4163-9516-2f7763bb40dc"/>
Jul 31 19:19:04 user nova-compute[72810]:       <nova:ports>
Jul 31 19:19:04 user nova-compute[72810]:         <nova:port uuid="3edb385d-c1ce-43d3-9e7f-7da09230fbc7">
Jul 31 19:19:04 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 19:19:04 user nova-compute[72810]:         </nova:port>
Jul 31 19:19:04 user nova-compute[72810]:       </nova:ports>
Jul 31 19:19:04 user nova-compute[72810]:     </nova:instance>
Jul 31 19:19:04 user nova-compute[72810]:   </metadata>
Jul 31 19:19:04 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:19:04 user nova-compute[72810]:     <system>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="serial">9e60b1bd-1f5e-4451-8d42-c6ee55483083</entry>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="uuid">9e60b1bd-1f5e-4451-8d42-c6ee55483083</entry>
Jul 31 19:19:04 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:19:04 user nova-compute[72810]:     </system>
Jul 31 19:19:04 user nova-compute[72810]:   </sysinfo>
Jul 31 19:19:04 user nova-compute[72810]:   <os>
Jul 31 19:19:04 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:19:04 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:19:04 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:19:04 user nova-compute[72810]:   </os>
Jul 31 19:19:04 user nova-compute[72810]:   <features>
Jul 31 19:19:04 user nova-compute[72810]:     <acpi/>
Jul 31 19:19:04 user nova-compute[72810]:     <apic/>
Jul 31 19:19:04 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:19:04 user nova-compute[72810]:   </features>
Jul 31 19:19:04 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:19:04 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:19:04 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:19:04 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:19:04 user nova-compute[72810]:   </clock>
Jul 31 19:19:04 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:19:04 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:19:04 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:19:04 user nova-compute[72810]:   </cpu>
Jul 31 19:19:04 user nova-compute[72810]:   <devices>
Jul 31 19:19:04 user nova-compute[72810]:     <disk type="file" device="disk">
Jul 31 19:19:04 user nova-compute[72810]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 19:19:04 user nova-compute[72810]:       <source file="/opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk"/>
Jul 31 19:19:04 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:19:04 user nova-compute[72810]:     </disk>
Jul 31 19:19:04 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:19:04 user nova-compute[72810]:       <mac address="fa:16:3e:b7:06:e0"/>
Jul 31 19:19:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:19:04 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:19:04 user nova-compute[72810]:       <target dev="tap3edb385d-c1"/>
Jul 31 19:19:04 user nova-compute[72810]:     </interface>
Jul 31 19:19:04 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:19:04 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/console.log" append="off"/>
Jul 31 19:19:04 user nova-compute[72810]:     </serial>
Jul 31 19:19:04 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:19:04 user nova-compute[72810]:     <video>
Jul 31 19:19:04 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:19:04 user nova-compute[72810]:     </video>
Jul 31 19:19:04 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:19:04 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:19:04 user nova-compute[72810]:     </rng>
Jul 31 19:19:04 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:19:04 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:19:04 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:19:04 user nova-compute[72810]:     </memballoon>
Jul 31 19:19:04 user nova-compute[72810]:   </devices>
Jul 31 19:19:04 user nova-compute[72810]: </domain>
Jul 31 19:19:04 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564134153',display_name='tempest-TestStampPattern-server-1564134153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564134153',id=45,image_ref='37148163-4854-4163-9516-2f7763bb40dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-7oycccxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f86efd13-e201-475a-8011-fbe4eb144b3a',image_min_disk='1',image_min_ram='0',image_owner_id='9574f7601d6c4284b868f80b504ce01e',image_owner_project_name='tempest-TestStampPattern-1120068081',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1120068081-project-member',image_user_id='b1c44c8bfac8422fa73b4449e98ef553',network_allocated='True',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:19:02Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=9e60b1bd-1f5e-4451-8d42-c6ee55483083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG os_vif [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3edb385d-c1, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3edb385d-c1, col_values=(('external_ids', {'iface-id': '3edb385d-c1ce-43d3-9e7f-7da09230fbc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:06:e0', 'vm-uuid': '9e60b1bd-1f5e-4451-8d42-c6ee55483083'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:04 user nova-compute[72810]: INFO os_vif [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1')
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No VIF found with MAC fa:16:3e:b7:06:e0, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updated VIF entry in instance network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:19:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf3dc032-43ab-431f-a0ee-08f8d865b076 req-424c044c-a3ca-43e0-8ef0-ac4596d7fecd service nova] Releasing lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:19:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:06 user nova-compute[72810]: DEBUG nova.compute.manager [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] No waiting events found dispatching network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:19:06 user nova-compute[72810]: WARNING nova.compute.manager [req-4def6f42-cd08-4e07-bf90-ae4921c9c030 req-d463970a-ab88-443f-a3ce-3f1410788635 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received unexpected event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 for instance with vm_state building and task_state spawning.
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831147.9546258, 9e60b1bd-1f5e-4451-8d42-c6ee55483083 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:19:07 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] VM Resumed (Lifecycle Event)
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:19:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Instance spawned successfully.
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:19:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:19:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831147.9570901, 9e60b1bd-1f5e-4451-8d42-c6ee55483083 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:19:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] VM Started (Lifecycle Event)
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:19:08 user nova-compute[72810]: INFO nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Took 6.10 seconds to spawn the instance on the hypervisor.
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:19:08 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:19:08 user nova-compute[72810]: INFO nova.compute.manager [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Took 6.70 seconds to build instance.
Jul 31 19:19:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-a4075893-cdb9-4e47-9a20-752f3ea7e0b2 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.790s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] No waiting events found dispatching network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:19:08 user nova-compute[72810]: WARNING nova.compute.manager [req-ab45007a-08d2-4358-b822-fd965906f985 req-8b762439-c4a1-4cfc-9589-46a86ce50d4c service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received unexpected event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 for instance with vm_state active and task_state None.
Jul 31 19:19:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:19:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:19:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:19:44 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=25.087100982666016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:19:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:19:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:19:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:19:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:19:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:19:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:19:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:19:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:19:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:58 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:19:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:20:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:20:43 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:20:44 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:20:44 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.086284637451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:20:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:20:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:20:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:20:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:20:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:20:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.compute.manager [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing instance network info cache due to event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] Acquiring lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] Acquired lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:20:54 user nova-compute[72810]: INFO nova.compute.manager [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Attaching volume d98fda00-545e-4e7b-ad06-a99c1cc994ce to /dev/vdb
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updated VIF entry in instance network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.network.neutron [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bb1c075c-76bc-4c1a-873e-1b8045596ed3 req-a2ec3102-90b7-4e7c-b369-a993fa1c29b8 service nova] Releasing lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.utils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca059d1-109b-416d-9df9-d7e43f54c452]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00416c-91a0-45b4-9f70-5295f3a635ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69b7d7-3a9d-4c4c-b7d2-efe945b55bd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2aa4e-175c-4bf6-b9cb-19b6f76c5fc3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:20:54 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:20:54 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ec7fa9-4262-4f81-ad97-575fdda671c3]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG os_brick.utils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating existing volume attachment record: bdd975fc-13ac-4780-b8f8-9f659d8676fd {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:20:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:20:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:20:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:20:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:20:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:20:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:20:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:20:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:20:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:20:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjSbKDJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:21:01 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:21:01 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:21:01 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d18824d-f967-43ca-bac8-9c6d118df420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:21:01 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52bd3e5-1878-4b62-b28b-87f3b45b8f77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce] added
Jul 31 19:21:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e823f2-caa9-4b26-9804-c99af482a1e2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3abdb-2740-4180-a11d-f9719ff312f8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjSbKDJT {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RjSbKDJT" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[581a8df2-511a-4234-a202-8dd08c20f6bc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RjSbKDJT'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4e9cba-1086-4c39-b107-c912bab43f16]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6340100c-fdfb-4240-a56a-df41256cebe9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:21:01 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:21:01 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:21:01 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:21:01 user nova-compute[72810]: 
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847d586-7c8b-4bec-b7d9-9d5176c0d30f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260]
Jul 31 19:21:01 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260] successful.
Jul 31 19:21:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb16a93-5a7c-4a70-bcc2-7041f4d29a32]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e13bd6b-8bc6-4ba8-b8a3-aec8248b1f1d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)
Jul 31 19:21:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)
Jul 31 19:21:01 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e5865-2339-4563-a5b3-ea206671ac08]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:21:01 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjSbKDJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:21:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:21:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23438366238356563', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:21:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438366238356563', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:21:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 19:21:03 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:21:03 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:21:03 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:21:03 user nova-compute[72810]:   <serial>d98fda00-545e-4e7b-ad06-a99c1cc994ce</serial>
Jul 31 19:21:03 user nova-compute[72810]: </disk>
Jul 31 19:21:03 user nova-compute[72810]:  {{(pid=72810) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] No VIF found with MAC fa:16:3e:b7:06:e0, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-e97753f9-d7bc-466f-a873-0e53352f22d6 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.786s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:05 user nova-compute[72810]: INFO nova.compute.manager [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Detaching volume d98fda00-545e-4e7b-ad06-a99c1cc994ce
Jul 31 19:21:05 user nova-compute[72810]: INFO nova.virt.block_device [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Attempting to driver detach volume d98fda00-545e-4e7b-ad06-a99c1cc994ce from mountpoint /dev/vdb
Jul 31 19:21:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Attempting to detach device vdb from instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 from the persistent domain config. {{(pid=72810) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 19:21:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:21:05 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:21:05 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:21:05 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:21:05 user nova-compute[72810]:   <serial>d98fda00-545e-4e7b-ad06-a99c1cc994ce</serial>
Jul 31 19:21:05 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:21:05 user nova-compute[72810]: </disk>
Jul 31 19:21:05 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:21:05 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully detached device vdb from instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 from the persistent domain config.
Jul 31 19:21:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 from the live domain config. {{(pid=72810) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 19:21:05 user nova-compute[72810]: DEBUG nova.virt.libvirt.guest [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 19:21:05 user nova-compute[72810]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:21:05 user nova-compute[72810]:   <source dev="/dev/sdb"/>
Jul 31 19:21:05 user nova-compute[72810]:   <target dev="vdb" bus="virtio"/>
Jul 31 19:21:05 user nova-compute[72810]:   <serial>d98fda00-545e-4e7b-ad06-a99c1cc994ce</serial>
Jul 31 19:21:05 user nova-compute[72810]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 19:21:05 user nova-compute[72810]: </disk>
Jul 31 19:21:05 user nova-compute[72810]:  {{(pid=72810) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Received event <DeviceRemovedEvent: 1690831266.2747173, 9e60b1bd-1f5e-4451-8d42-c6ee55483083 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72810) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 19:21:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully detached device vdb from instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 from the live domain config.
Jul 31 19:21:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RjSbKDJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:21:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b2f3a-6be0-4d98-b85c-c95ec48769cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[041bf734-9e71-4a20-a3dc-969135da5228]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)
Jul 31 19:21:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce (non-flash)
Jul 31 19:21:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc215480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2053a41e-255c-4137-9602-460f439ea6a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e5e3b-8902-4c9d-87fc-036ca2182aea]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031069a-a735-4dbe-9b8e-f2c0c2ac8f82]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa182ca-8b8d-4eaa-8e1a-243d55a67946]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48d230-15a3-4aa5-a9cf-dce870262906]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e12e335-c4e8-4cea-939c-78747314f918]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260]
Jul 31 19:21:06 user nova-compute[72810]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce, portal: 172.16.0.220,3260] successful.
Jul 31 19:21:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d98fda00-545e-4e7b-ad06-a99c1cc994ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[226d63b2-d9b8-49f7-afa2-2eb9da9779b9]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] <== disconnect_volume: return (289ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:21:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:21:07 user nova-compute[72810]: DEBUG nova.objects.instance [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'flavor' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:21:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-ad19248b-7bd9-42c7-a84e-0dfab466514a tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:21:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:21:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:21:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:21:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:21:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:21:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:21:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=25.085163116455078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:21:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:47 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:47 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:21:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:21:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:21:55 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:21:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:21:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:21:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing instance network info cache due to event network-changed-3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] Acquiring lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] Acquired lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Refreshing network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:57 user nova-compute[72810]: INFO nova.compute.manager [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Terminating instance
Jul 31 19:21:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Instance destroyed successfully.
Jul 31 19:21:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'resources' on Instance uuid 9e60b1bd-1f5e-4451-8d42-c6ee55483083 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1564134153',display_name='tempest-TestStampPattern-server-1564134153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1564134153',id=45,image_ref='37148163-4854-4163-9516-2f7763bb40dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-7oycccxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f86efd13-e201-475a-8011-fbe4eb144b3a',image_min_disk='1',image_min_ram='0',image_owner_id='9574f7601d6c4284b868f80b504ce01e',image_owner_project_name='tempest-TestStampPattern-1120068081',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1120068081-project-member',image_user_id='b1c44c8bfac8422fa73b4449e98ef553',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:19:08Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=9e60b1bd-1f5e-4451-8d42-c6ee55483083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG os_vif [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3edb385d-c1, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:21:58 user nova-compute[72810]: INFO os_vif [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:06:e0,bridge_name='br-int',has_traffic_filtering=True,id=3edb385d-c1ce-43d3-9e7f-7da09230fbc7,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edb385d-c1')
Jul 31 19:21:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Deleting instance files /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083_del
Jul 31 19:21:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Deletion of /opt/stack/data/nova/instances/9e60b1bd-1f5e-4451-8d42-c6ee55483083_del complete
Jul 31 19:21:58 user nova-compute[72810]: INFO nova.compute.manager [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 19:21:58 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updated VIF entry in instance network info cache for port 3edb385d-c1ce-43d3-9e7f-7da09230fbc7. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [{"id": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "address": "fa:16:3e:b7:06:e0", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edb385d-c1", "ovs_interfaceid": "3edb385d-c1ce-43d3-9e7f-7da09230fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ae4c31c0-acc9-47bd-85a7-5a37a85e9f97 req-00294d5e-c01a-422d-8bec-404bf4c607b8 service nova] Releasing lock "refresh_cache-9e60b1bd-1f5e-4451-8d42-c6ee55483083" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:21:58 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Took 0.67 seconds to deallocate network for instance.
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-44f44fdb-69d9-4acb-88a3-0350bcda70bf req-c25c6bc4-f0b3-4ada-9e51-1b08a034c54d service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-vif-deleted-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:21:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:59 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Deleted allocations for instance 9e60b1bd-1f5e-4451-8d42-c6ee55483083
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-49bfa132-9fd3-4153-9347-0a88ac7471b3 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-vif-unplugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] No waiting events found dispatching network-vif-unplugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:21:59 user nova-compute[72810]: WARNING nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received unexpected event network-vif-unplugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 for instance with vm_state deleted and task_state None.
Jul 31 19:21:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Acquiring lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] Lock "9e60b1bd-1f5e-4451-8d42-c6ee55483083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:21:59 user nova-compute[72810]: DEBUG nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] No waiting events found dispatching network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:21:59 user nova-compute[72810]: WARNING nova.compute.manager [req-e97ab5c4-d392-4867-8514-7d1e393a4073 req-88bcbab5-a90f-40b5-8d17-cf3b946de6ec service nova] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Received unexpected event network-vif-plugged-3edb385d-c1ce-43d3-9e7f-7da09230fbc7 for instance with vm_state deleted and task_state None.
Jul 31 19:21:59 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:12 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690831317.9808974, 9e60b1bd-1f5e-4451-8d42-c6ee55483083 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:22:12 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] VM Stopped (Lifecycle Event)
Jul 31 19:22:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-4a797b39-982c-4abd-b718-90d25b7489a7 None None] [instance: 9e60b1bd-1f5e-4451-8d42-c6ee55483083] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:22:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:22:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:22:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:22:44 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:22:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:22:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.085777282714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f86efd13-e201-475a-8011-fbe4eb144b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:22:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:22:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-changed-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing instance network info cache due to event network-changed-704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] Acquiring lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] Acquired lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Refreshing network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:56 user nova-compute[72810]: INFO nova.compute.manager [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Terminating instance
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-unplugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] No waiting events found dispatching network-vif-unplugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [req-72e94410-05b9-460e-b2ea-769e0f6b4562 req-05f8e3e6-9dd2-4073-ac7b-5d5f4b9a6661 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-unplugged-704b4638-e102-4844-8805-11c7a2f3f456 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updated VIF entry in instance network info cache for port 704b4638-e102-4844-8805-11c7a2f3f456. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG nova.network.neutron [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [{"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-fb091bdb-d867-41a3-a907-8f53d0c8ee8b req-abd5fd84-1d43-43e2-b021-108f2e99030a service nova] Releasing lock "refresh_cache-f86efd13-e201-475a-8011-fbe4eb144b3a" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:22:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Instance destroyed successfully.
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.objects.instance [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lazy-loading 'resources' on Instance uuid f86efd13-e201-475a-8011-fbe4eb144b3a {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-846473206',display_name='tempest-TestStampPattern-server-846473206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-846473206',id=44,image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyZAiuGnBsq8nFqJVli8gowMLsqww67z4N9SP7+W1Zm2VGtX3UoPS7jF010KoUrSNdxG9JB6YWJD7mhehd5+u20szIkearhZTd9dOwg0Us9y6ppwa8+6Oex5JhbJj6ffg==',key_name='tempest-TestStampPattern-804974880',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9574f7601d6c4284b868f80b504ce01e',ramdisk_id='',reservation_id='r-k73ku66c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0efe86ed-5b8c-473b-b5ee-c879a1eae6b6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1120068081',owner_user_name='tempest-TestStampPattern-1120068081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:18:59Z,user_data=None,user_id='b1c44c8bfac8422fa73b4449e98ef553',uuid=f86efd13-e201-475a-8011-fbe4eb144b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converting VIF {"id": "704b4638-e102-4844-8805-11c7a2f3f456", "address": "fa:16:3e:be:84:5e", "network": {"id": "5bc982cd-71dd-41ee-89e6-01c74efe146d", "bridge": "br-int", "label": "tempest-TestStampPattern-772021083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9574f7601d6c4284b868f80b504ce01e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap704b4638-e1", "ovs_interfaceid": "704b4638-e102-4844-8805-11c7a2f3f456", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG os_vif [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap704b4638-e1, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:22:57 user nova-compute[72810]: INFO os_vif [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:84:5e,bridge_name='br-int',has_traffic_filtering=True,id=704b4638-e102-4844-8805-11c7a2f3f456,network=Network(5bc982cd-71dd-41ee-89e6-01c74efe146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap704b4638-e1')
Jul 31 19:22:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Deleting instance files /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a_del
Jul 31 19:22:57 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Deletion of /opt/stack/data/nova/instances/f86efd13-e201-475a-8011-fbe4eb144b3a_del complete
Jul 31 19:22:57 user nova-compute[72810]: INFO nova.compute.manager [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 19:22:57 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:22:57 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Took 0.58 seconds to deallocate network for instance.
Jul 31 19:22:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:58 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Deleted allocations for instance f86efd13-e201-475a-8011-fbe4eb144b3a
Jul 31 19:22:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-7dc0e9af-9f9e-4818-8f0a-eb85b500a211 tempest-TestStampPattern-1120068081 tempest-TestStampPattern-1120068081-project-member] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-5af67053-d669-455c-84fc-96b3b5216253 req-40339dfa-0434-447b-9bf7-aee56b40dad1 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-deleted-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] Acquiring lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] Lock "f86efd13-e201-475a-8011-fbe4eb144b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:22:58 user nova-compute[72810]: DEBUG nova.compute.manager [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] No waiting events found dispatching network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:22:58 user nova-compute[72810]: WARNING nova.compute.manager [req-bdfb940b-9b89-4648-bce8-d37a8c323afd req-c2e7d5ff-b149-4c2c-b9c0-b1be2e3be496 service nova] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Received unexpected event network-vif-plugged-704b4638-e102-4844-8805-11c7a2f3f456 for instance with vm_state deleted and task_state None.
Jul 31 19:23:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:12 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690831377.1732562, f86efd13-e201-475a-8011-fbe4eb144b3a => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:23:12 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] VM Stopped (Lifecycle Event)
Jul 31 19:23:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-34158fec-3dee-4efd-af35-a9d7a7062a35 None None] [instance: f86efd13-e201-475a-8011-fbe4eb144b3a] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:23:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:23:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:23:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:23:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:44 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:23:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:23:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:23:44 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:23:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:23:45 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.210407257080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:23:45 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:23:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:23:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:23:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:23:58 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:23:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:23:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:23:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:24:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:24:25 user nova-compute[72810]: INFO nova.compute.claims [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Claim successful on node user
Jul 31 19:24:25 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:24:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:24:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:24:26 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:24:26 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:24:26 user nova-compute[72810]: INFO nova.virt.block_device [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Booting with volume snapshot f9aa6d7f-79e4-4b8b-9619-356f611f535e at /dev/vda
Jul 31 19:24:26 user nova-compute[72810]: DEBUG nova.policy [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:24:26 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Successfully created port: ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Successfully updated port: ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-changed-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.compute.manager [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Refreshing instance network info cache due to event network-changed-ba948c21-1343-4007-a8ac-d2ef9fe6f186. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] Acquiring lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:24:27 user nova-compute[72810]: DEBUG nova.network.neutron [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating instance_info_cache with network_info: [{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Instance network_info: |[{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] Acquired lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Refreshing network info cache for port ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updated VIF entry in instance network info cache for port ba948c21-1343-4007-a8ac-d2ef9fe6f186. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG nova.network.neutron [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating instance_info_cache with network_info: [{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-93d3c5b2-b2db-4fd6-b697-3a0faf83f15d req-94d80ad9-30b4-41fd-97cd-bedb807e9524 service nova] Releasing lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:24:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.utils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1dbde5-4f57-4777-8fcb-b207212a89e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[581cec3c-f380-437b-8ebb-b55456f9cb9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ca1d52-4889-4861-b660-9a35902c2ec9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6bd65d-b632-4eb8-acd7-8f4294e37f70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:24:31 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:24:31 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc48b9b-b8c5-4202-b31f-700552297b69]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG os_brick.utils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:24:31 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating existing volume attachment record: a5f65a15-763c-45cc-95dd-029286d9e598 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:24:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:24:38 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Creating image(s)
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Ensure instance console log exists: /opt/stack/data/nova/instances/f044049c-29d1-494b-93f2-101d5446b369/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Start _get_guest_xml network_info=[{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdbAPjMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f044049c-29d1-494b-93f2-101d5446b369', 'attached_at': '', 'detached_at': '', 'volume_id': '0c27d89e-b172-4339-b01f-ded3c7ffee42', 'serial': '0c27d89e-b172-4339-b01f-ded3c7ffee42'}, 'attachment_id': 'a5f65a15-763c-45cc-95dd-029286d9e598', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:24:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:24:38 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:24:38 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdbAPjMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:24:39 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:24:39 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:24:39 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:24:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efe7140-7b74-4ea5-b8be-65cc5294d51a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:24:39 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b624d111-66ed-4667-849c-0261ab45b388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42] added
Jul 31 19:24:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b409c9-c3da-4e35-9d4d-6df3166be860]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc5129-d5a4-4932-92a9-962a6f8893a2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdbAPjMX {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdbAPjMX" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e4c87d-58c0-476f-8861-e294fafe28fe]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdbAPjMX'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa64e65-b81a-4117-802b-59781598898f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b2623e-2bdc-4938-a899-5a9769c551dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:24:39 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:24:39 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:24:39 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:24:39 user nova-compute[72810]: 
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f1595-6a7d-46fb-adb8-a05b618927e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260]
Jul 31 19:24:39 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260] successful.
Jul 31 19:24:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9538fee-0e8e-418b-a476-9114641795cd]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd09cd-d083-4ba2-a0cc-e303a85689e3]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)
Jul 31 19:24:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)
Jul 31 19:24:39 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3261d-776f-43ae-ae0a-a1e6fc28d6bc]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:24:39 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdbAPjMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23264356461656432', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264356461656432', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1649153829',display_name='tempest-TestVolumeBootPattern-server-1649153829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1649153829',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-3uplpz07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:24:26Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=f044049c-29d1-494b-93f2-101d5446b369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.objects.instance [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid f044049c-29d1-494b-93f2-101d5446b369 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:24:40 user nova-compute[72810]:   <uuid>f044049c-29d1-494b-93f2-101d5446b369</uuid>
Jul 31 19:24:40 user nova-compute[72810]:   <name>instance-0000002e</name>
Jul 31 19:24:40 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:24:40 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:24:40 user nova-compute[72810]:   <metadata>
Jul 31 19:24:40 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:24:40 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:24:40 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-server-1649153829</nova:name>
Jul 31 19:24:40 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:24:38</nova:creationTime>
Jul 31 19:24:40 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:24:40 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:24:40 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:24:40 user nova-compute[72810]:       <nova:owner>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:24:40 user nova-compute[72810]:       </nova:owner>
Jul 31 19:24:40 user nova-compute[72810]:       <nova:ports>
Jul 31 19:24:40 user nova-compute[72810]:         <nova:port uuid="ba948c21-1343-4007-a8ac-d2ef9fe6f186">
Jul 31 19:24:40 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 19:24:40 user nova-compute[72810]:         </nova:port>
Jul 31 19:24:40 user nova-compute[72810]:       </nova:ports>
Jul 31 19:24:40 user nova-compute[72810]:     </nova:instance>
Jul 31 19:24:40 user nova-compute[72810]:   </metadata>
Jul 31 19:24:40 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:24:40 user nova-compute[72810]:     <system>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="serial">f044049c-29d1-494b-93f2-101d5446b369</entry>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="uuid">f044049c-29d1-494b-93f2-101d5446b369</entry>
Jul 31 19:24:40 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:24:40 user nova-compute[72810]:     </system>
Jul 31 19:24:40 user nova-compute[72810]:   </sysinfo>
Jul 31 19:24:40 user nova-compute[72810]:   <os>
Jul 31 19:24:40 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:24:40 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:24:40 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:24:40 user nova-compute[72810]:   </os>
Jul 31 19:24:40 user nova-compute[72810]:   <features>
Jul 31 19:24:40 user nova-compute[72810]:     <acpi/>
Jul 31 19:24:40 user nova-compute[72810]:     <apic/>
Jul 31 19:24:40 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:24:40 user nova-compute[72810]:   </features>
Jul 31 19:24:40 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:24:40 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:24:40 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:24:40 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:24:40 user nova-compute[72810]:   </clock>
Jul 31 19:24:40 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:24:40 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:24:40 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:24:40 user nova-compute[72810]:   </cpu>
Jul 31 19:24:40 user nova-compute[72810]:   <devices>
Jul 31 19:24:40 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:24:40 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:24:40 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 19:24:40 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:24:40 user nova-compute[72810]:       <serial>0c27d89e-b172-4339-b01f-ded3c7ffee42</serial>
Jul 31 19:24:40 user nova-compute[72810]:     </disk>
Jul 31 19:24:40 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:24:40 user nova-compute[72810]:       <mac address="fa:16:3e:6e:8a:56"/>
Jul 31 19:24:40 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:24:40 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:24:40 user nova-compute[72810]:       <target dev="tapba948c21-13"/>
Jul 31 19:24:40 user nova-compute[72810]:     </interface>
Jul 31 19:24:40 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:24:40 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/f044049c-29d1-494b-93f2-101d5446b369/console.log" append="off"/>
Jul 31 19:24:40 user nova-compute[72810]:     </serial>
Jul 31 19:24:40 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:24:40 user nova-compute[72810]:     <video>
Jul 31 19:24:40 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:24:40 user nova-compute[72810]:     </video>
Jul 31 19:24:40 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:24:40 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:24:40 user nova-compute[72810]:     </rng>
Jul 31 19:24:40 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:24:40 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:24:40 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:24:40 user nova-compute[72810]:     </memballoon>
Jul 31 19:24:40 user nova-compute[72810]:   </devices>
Jul 31 19:24:40 user nova-compute[72810]: </domain>
Jul 31 19:24:40 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1649153829',display_name='tempest-TestVolumeBootPattern-server-1649153829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1649153829',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-3uplpz07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:24:26Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=f044049c-29d1-494b-93f2-101d5446b369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG os_vif [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba948c21-13, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba948c21-13, col_values=(('external_ids', {'iface-id': 'ba948c21-1343-4007-a8ac-d2ef9fe6f186', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:8a:56', 'vm-uuid': 'f044049c-29d1-494b-93f2-101d5446b369'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:40 user nova-compute[72810]: INFO os_vif [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13')
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:24:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:6e:8a:56, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] No waiting events found dispatching network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:24:41 user nova-compute[72810]: WARNING nova.compute.manager [req-e37b6cfa-2328-4267-95f8-2388f13f49db req-ff6db439-62c8-4071-af7c-7276b62ddefe service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received unexpected event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 for instance with vm_state building and task_state spawning.
Jul 31 19:24:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831483.818263, f044049c-29d1-494b-93f2-101d5446b369 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] VM Resumed (Lifecycle Event)
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] Instance spawned successfully.
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831483.820165, f044049c-29d1-494b-93f2-101d5446b369 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] VM Started (Lifecycle Event)
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] No waiting events found dispatching network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:24:43 user nova-compute[72810]: WARNING nova.compute.manager [req-f469d04d-176f-4e88-9ef3-46c7eb88fd22 req-dc94c035-c3b4-48d0-815a-c38c55081ec0 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received unexpected event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 for instance with vm_state building and task_state spawning.
Jul 31 19:24:43 user nova-compute[72810]: INFO nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Took 5.01 seconds to spawn the instance on the hypervisor.
Jul 31 19:24:43 user nova-compute[72810]: DEBUG nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:24:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:44 user nova-compute[72810]: INFO nova.compute.manager [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Took 18.32 seconds to build instance.
Jul 31 19:24:44 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-dc5a93a8-ee11-47ee-a376-f02b78fdb80b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.444s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:24:46 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:24:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:24:47 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.199092864990234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f044049c-29d1-494b-93f2-101d5446b369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:24:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:24:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:50 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:24:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f044049c-29d1-494b-93f2-101d5446b369 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:24:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:24:59 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating instance_info_cache with network_info: [{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:24:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:24:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:24:59 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:25:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:25:48 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:25:49 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:25:49 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=25.19839859008789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance f044049c-29d1-494b-93f2-101d5446b369 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:25:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:25:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:25:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:25:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:25:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:25:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:59 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:25:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:25:59 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid f044049c-29d1-494b-93f2-101d5446b369 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:01 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating instance_info_cache with network_info: [{"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:26:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-f044049c-29d1-494b-93f2-101d5446b369" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:26:01 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:26:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:16 user nova-compute[72810]: INFO nova.compute.manager [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Terminating instance
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.compute.manager [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-unplugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.compute.manager [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] No waiting events found dispatching network-vif-unplugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.compute.manager [req-c3422d35-2815-4f99-8b95-e025a2445c96 req-1540aacf-9cb5-46e6-9eb3-ccf03be47460 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-unplugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] Instance destroyed successfully.
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.objects.instance [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid f044049c-29d1-494b-93f2-101d5446b369 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1649153829',display_name='tempest-TestVolumeBootPattern-server-1649153829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1649153829',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-3uplpz07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:24:44Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=f044049c-29d1-494b-93f2-101d5446b369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "address": "fa:16:3e:6e:8a:56", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba948c21-13", "ovs_interfaceid": "ba948c21-1343-4007-a8ac-d2ef9fe6f186", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_vif [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba948c21-13, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:16 user nova-compute[72810]: INFO os_vif [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:8a:56,bridge_name='br-int',has_traffic_filtering=True,id=ba948c21-1343-4007-a8ac-d2ef9fe6f186,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba948c21-13')
Jul 31 19:26:16 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdbAPjMX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:26:16 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ede8a8-e120-4aad-bae5-c1eb54bd8513]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cadf31-1f78-46fc-896a-a31298029c0a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)
Jul 31 19:26:16 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 (non-flash)
Jul 31 19:26:16 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68f4907520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:26:16 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d287f3-fc15-43d6-823c-29070c92f1a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c9fc4e-984b-4edf-a81a-c5fbcb649863]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9492eaa-f1c0-4828-8f22-b1f0f4c435ec]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c499e938-1ca4-4437-b16c-b3b6fa15853d]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23264356461656432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c710ec7', '/dev/disk/by-id/scsi-1SCST_BIO3c710ec7-2d5daed281a5b78f') {{(pid=84119) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e1707-3cd0-4077-bfbb-6bad8c06f0fa]: (4, None) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d069e-9c9c-4f38-9d16-2b6dcf4f7788]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff578601-dee3-4741-bdbc-2f1e960d491e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260]
Jul 31 19:26:17 user nova-compute[72810]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42, portal: 172.16.0.220,3260] successful.
Jul 31 19:26:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c27d89e-b172-4339-b01f-ded3c7ffee42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0463cdd1-084a-4e43-8e46-18ce3bdb6faa]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (249ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:26:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Deleting instance files /opt/stack/data/nova/instances/f044049c-29d1-494b-93f2-101d5446b369_del
Jul 31 19:26:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Deletion of /opt/stack/data/nova/instances/f044049c-29d1-494b-93f2-101d5446b369_del complete
Jul 31 19:26:17 user nova-compute[72810]: INFO nova.compute.manager [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Took 1.10 seconds to destroy the instance on the hypervisor.
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:26:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:26:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] Took 0.77 seconds to deallocate network for instance.
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] Acquiring lock "f044049c-29d1-494b-93f2-101d5446b369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] Lock "f044049c-29d1-494b-93f2-101d5446b369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] No waiting events found dispatching network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:26:18 user nova-compute[72810]: WARNING nova.compute.manager [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received unexpected event network-vif-plugged-ba948c21-1343-4007-a8ac-d2ef9fe6f186 for instance with vm_state active and task_state deleting.
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.compute.manager [req-3e6f9ea8-ca58-4baf-970e-68ef8c9d71a2 req-fd568b29-5dbc-4332-b60a-0cc6871037b3 service nova] [instance: f044049c-29d1-494b-93f2-101d5446b369] Received event network-vif-deleted-ba948c21-1343-4007-a8ac-d2ef9fe6f186 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:26:18 user nova-compute[72810]: INFO nova.compute.manager [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Took 0.71 seconds to detach 1 volumes for instance.
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: f044049c-29d1-494b-93f2-101d5446b369] Deleting volume: 0c27d89e-b172-4339-b01f-ded3c7ffee42 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:26:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:19 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance f044049c-29d1-494b-93f2-101d5446b369
Jul 31 19:26:19 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-b177f8b7-53af-4ed8-b463-38678a0be219 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "f044049c-29d1-494b-93f2-101d5446b369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.959s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:31 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690831576.888995, f044049c-29d1-494b-93f2-101d5446b369 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:26:31 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: f044049c-29d1-494b-93f2-101d5446b369] VM Stopped (Lifecycle Event)
Jul 31 19:26:31 user nova-compute[72810]: DEBUG nova.compute.manager [None req-7af7cd36-112d-47e2-8eb9-568a14ab699e None None] [instance: f044049c-29d1-494b-93f2-101d5446b369] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:26:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:26:50 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:26:50 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.19760513305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:26:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:26:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:26:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:26:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:27:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:27:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:27:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:08 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:27:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:27:22 user nova-compute[72810]: INFO nova.compute.claims [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Claim successful on node user
Jul 31 19:27:22 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.172s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:27:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:27:23 user nova-compute[72810]: INFO nova.virt.block_device [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Booting with volume 20cbc4aa-0015-4694-98d7-eb75c6d5c07d at /dev/vda
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.policy [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.utils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[66912360-15c4-4220-8826-60e007b5e3c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace4995-fd05-4970-87ba-d803881a5fef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[98847431-de52-410e-9105-77752f7fccd2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c6a4cb-9c40-47b7-83f2-cc5ae92cd8d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:27:23 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:27:23 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f5abf3-8813-4dd7-831e-8cebc7d04ecb]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG os_brick.utils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating existing volume attachment record: 183d2f96-1d5e-486b-8707-994758441944 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:27:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Successfully created port: 71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Successfully updated port: 71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-changed-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Refreshing instance network info cache due to event network-changed-71eb14d9-5ea8-4294-893e-91bb33dd2a46. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:27:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Instance network_info: |[{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Refreshing network info cache for port 71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated VIF entry in instance network info cache for port 71eb14d9-5ea8-4294-893e-91bb33dd2a46. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:27:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-185a452c-c182-4f71-ab5e-6ec303142333 req-581e032b-90c3-4d4c-90b1-b9e2538677a9 service nova] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:27:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:27:30 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Creating image(s)
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Ensure instance console log exists: /opt/stack/data/nova/instances/90cfeb79-96d7-4f67-9cdb-19c19bafe3f5/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Start _get_guest_xml network_info=[{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyNbnCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '90cfeb79-96d7-4f67-9cdb-19c19bafe3f5', 'attached_at': '', 'detached_at': '', 'volume_id': '20cbc4aa-0015-4694-98d7-eb75c6d5c07d', 'serial': '20cbc4aa-0015-4694-98d7-eb75c6d5c07d'}, 'attachment_id': '183d2f96-1d5e-486b-8707-994758441944', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:27:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:27:30 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyNbnCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:27:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:27:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:27:30 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d21d2-bcdc-4570-b618-de9d46dea379]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:27:30 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[70308fb4-dfad-4fa3-a20b-2288e786b689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d] added
Jul 31 19:27:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[008150ac-690f-49ea-a2a8-5b9607bd6938]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[701dc852-eacc-4750-a48f-158d879f11e8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPyNbnCI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BPyNbnCI" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61cff9f-ecd1-43a1-908c-27a6a82e8c61]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BPyNbnCI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[394431f6-49e5-4373-8278-db82b2423299]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[60952420-375e-4bb5-a14e-32e431b7edac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:27:30 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:27:30 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:27:30 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:27:30 user nova-compute[72810]: 
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2749bd4-76df-4322-9afb-52924dba0aef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260]
Jul 31 19:27:30 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260] successful.
Jul 31 19:27:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[30983e87-7c64-4766-918f-a5662dd174ec]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2acf90e-186d-49a9-b63f-56b5f7ee4f24]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:27:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:27:30 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1a17c-92bf-484e-835f-2c38919814e7]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:27:30 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyNbnCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26464346161653363', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464346161653363', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1202235357',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyo4q9R1kg+cC+8SX8a4KV3ktMuQkhUXmGaz9sk9holz2OVPwrtxsIzGQ20FbR1mEKDBUvpEMGq1WFfrYIigxjrbP5qvLJ06Wiv9aVfMxDp2iFY20feq4mrC1QjQQz6Yw==',key_name='tempest-keypair-2022510686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-v3z0tg4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=90cfeb79-96d7-4f67-9cdb-19c19bafe3f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.objects.instance [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:27:31 user nova-compute[72810]:   <uuid>90cfeb79-96d7-4f67-9cdb-19c19bafe3f5</uuid>
Jul 31 19:27:31 user nova-compute[72810]:   <name>instance-0000002f</name>
Jul 31 19:27:31 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:27:31 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:27:31 user nova-compute[72810]:   <metadata>
Jul 31 19:27:31 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:27:31 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:27:31 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1202235357</nova:name>
Jul 31 19:27:31 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:27:30</nova:creationTime>
Jul 31 19:27:31 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:27:31 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:27:31 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:27:31 user nova-compute[72810]:       <nova:owner>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:27:31 user nova-compute[72810]:       </nova:owner>
Jul 31 19:27:31 user nova-compute[72810]:       <nova:ports>
Jul 31 19:27:31 user nova-compute[72810]:         <nova:port uuid="71eb14d9-5ea8-4294-893e-91bb33dd2a46">
Jul 31 19:27:31 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 19:27:31 user nova-compute[72810]:         </nova:port>
Jul 31 19:27:31 user nova-compute[72810]:       </nova:ports>
Jul 31 19:27:31 user nova-compute[72810]:     </nova:instance>
Jul 31 19:27:31 user nova-compute[72810]:   </metadata>
Jul 31 19:27:31 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:27:31 user nova-compute[72810]:     <system>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="serial">90cfeb79-96d7-4f67-9cdb-19c19bafe3f5</entry>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="uuid">90cfeb79-96d7-4f67-9cdb-19c19bafe3f5</entry>
Jul 31 19:27:31 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:27:31 user nova-compute[72810]:     </system>
Jul 31 19:27:31 user nova-compute[72810]:   </sysinfo>
Jul 31 19:27:31 user nova-compute[72810]:   <os>
Jul 31 19:27:31 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:27:31 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:27:31 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:27:31 user nova-compute[72810]:   </os>
Jul 31 19:27:31 user nova-compute[72810]:   <features>
Jul 31 19:27:31 user nova-compute[72810]:     <acpi/>
Jul 31 19:27:31 user nova-compute[72810]:     <apic/>
Jul 31 19:27:31 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:27:31 user nova-compute[72810]:   </features>
Jul 31 19:27:31 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:27:31 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:27:31 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:27:31 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:27:31 user nova-compute[72810]:   </clock>
Jul 31 19:27:31 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:27:31 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:27:31 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:27:31 user nova-compute[72810]:   </cpu>
Jul 31 19:27:31 user nova-compute[72810]:   <devices>
Jul 31 19:27:31 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:27:31 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:27:31 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 19:27:31 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:27:31 user nova-compute[72810]:       <serial>20cbc4aa-0015-4694-98d7-eb75c6d5c07d</serial>
Jul 31 19:27:31 user nova-compute[72810]:     </disk>
Jul 31 19:27:31 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:27:31 user nova-compute[72810]:       <mac address="fa:16:3e:fc:b8:c4"/>
Jul 31 19:27:31 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:27:31 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:27:31 user nova-compute[72810]:       <target dev="tap71eb14d9-5e"/>
Jul 31 19:27:31 user nova-compute[72810]:     </interface>
Jul 31 19:27:31 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:27:31 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/90cfeb79-96d7-4f67-9cdb-19c19bafe3f5/console.log" append="off"/>
Jul 31 19:27:31 user nova-compute[72810]:     </serial>
Jul 31 19:27:31 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:27:31 user nova-compute[72810]:     <video>
Jul 31 19:27:31 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:27:31 user nova-compute[72810]:     </video>
Jul 31 19:27:31 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:27:31 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:27:31 user nova-compute[72810]:     </rng>
Jul 31 19:27:31 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:27:31 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:27:31 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:27:31 user nova-compute[72810]:     </memballoon>
Jul 31 19:27:31 user nova-compute[72810]:   </devices>
Jul 31 19:27:31 user nova-compute[72810]: </domain>
Jul 31 19:27:31 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1202235357',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyo4q9R1kg+cC+8SX8a4KV3ktMuQkhUXmGaz9sk9holz2OVPwrtxsIzGQ20FbR1mEKDBUvpEMGq1WFfrYIigxjrbP5qvLJ06Wiv9aVfMxDp2iFY20feq4mrC1QjQQz6Yw==',key_name='tempest-keypair-2022510686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-v3z0tg4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:27:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=90cfeb79-96d7-4f67-9cdb-19c19bafe3f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG os_vif [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71eb14d9-5e, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71eb14d9-5e, col_values=(('external_ids', {'iface-id': '71eb14d9-5ea8-4294-893e-91bb33dd2a46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b8:c4', 'vm-uuid': '90cfeb79-96d7-4f67-9cdb-19c19bafe3f5'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:31 user nova-compute[72810]: INFO os_vif [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e')
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:27:31 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:fc:b8:c4, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:27:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG nova.compute.manager [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] No waiting events found dispatching network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:27:33 user nova-compute[72810]: WARNING nova.compute.manager [req-bef7c732-7164-43d8-9fc4-d15caf32921c req-3b3d27b9-ce39-49c6-8690-6b669745759a service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received unexpected event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 for instance with vm_state building and task_state spawning.
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831655.0558112, 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] VM Resumed (Lifecycle Event)
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Instance spawned successfully.
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831655.0581446, 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] VM Started (Lifecycle Event)
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Took 4.82 seconds to spawn the instance on the hypervisor.
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:27:35 user nova-compute[72810]: INFO nova.compute.manager [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Took 12.46 seconds to build instance.
Jul 31 19:27:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-70c16f90-4d0d-4eb4-91cf-a3014d25275c tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.558s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:35 user nova-compute[72810]: DEBUG nova.compute.manager [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] No waiting events found dispatching network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:27:35 user nova-compute[72810]: WARNING nova.compute.manager [req-c0d2ed9a-53b6-4149-93d8-a34db8e5cd1c req-543be3c2-5a6c-4507-abf8-e864aa747c07 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received unexpected event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 for instance with vm_state active and task_state None.
Jul 31 19:27:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:27:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:27:49 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:27:50 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:27:50 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=25.195507049560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:27:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:27:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:27:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:27:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:27:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:28:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:28:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:28:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:28:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:28:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:28:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:28:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:28:51 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:28:51 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.194835662841797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:28:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:28:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:28:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:28:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:28:59 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:29:02 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:29:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:29:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:29:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:29:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-changed-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Refreshing instance network info cache due to event network-changed-71eb14d9-5ea8-4294-893e-91bb33dd2a46. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Refreshing network info cache for port 71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated VIF entry in instance network info cache for port 71eb14d9-5ea8-4294-893e-91bb33dd2a46. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:29:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-2377c3ab-e5d7-4866-9371-271a28fd5560 req-226d8c0b-22cc-4685-b729-e33e62666ea3 service nova] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:29:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:29:22 user nova-compute[72810]: INFO nova.compute.claims [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Claim successful on node user
Jul 31 19:29:22 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:29:23 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:29:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:29:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:29:23 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:29:23 user nova-compute[72810]: INFO nova.virt.block_device [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Booting with volume snapshot d69d9f49-2f20-4056-8970-df0473f4208b at /dev/vda
Jul 31 19:29:23 user nova-compute[72810]: DEBUG nova.policy [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:29:23 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Successfully created port: 60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Successfully updated port: 60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-changed-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG nova.compute.manager [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Refreshing instance network info cache due to event network-changed-60fa3946-7aaa-480c-9fd0-fd19a837e01f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] Acquiring lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:29:24 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG nova.network.neutron [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating instance_info_cache with network_info: [{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Instance network_info: |[{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] Acquired lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Refreshing network info cache for port 60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updated VIF entry in instance network info cache for port 60fa3946-7aaa-480c-9fd0-fd19a837e01f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG nova.network.neutron [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating instance_info_cache with network_info: [{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:29:25 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-41da3ab5-6086-4996-8a4c-88edd5a62f03 req-a088938b-f4ac-4ff3-9a2a-6f476aaf0563 service nova] Releasing lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:29:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[36452d5d-6f14-45a9-af20-5bb8bf60c64e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b18b7-8779-44a5-b894-f7dee3e5ec3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b50ae-f88b-4314-b272-43b4b16c431c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92b61b-6c7b-425b-aa74-e67468898f1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:29:28 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:29:28 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c46b1fd-8882-4a5e-88cf-cb0706cd4dea]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG os_brick.utils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:29:28 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating existing volume attachment record: 80ec6ef9-66dd-4940-a0c7-4979b81d3476 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:29:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:29:36 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Creating image(s)
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Ensure instance console log exists: /opt/stack/data/nova/instances/333a49fa-6f05-4b8a-ba61-933c79857229/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Start _get_guest_xml network_info=[{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T19:29:16Z,direct_url=<?>,disk_format='qcow2',id=edb212e6-a11d-470b-ba78-a631129a6ee2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1991169716',owner='48969fbade07485885e72fc3a2964678',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T19:29:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrvJSxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '333a49fa-6f05-4b8a-ba61-933c79857229', 'attached_at': '', 'detached_at': '', 'volume_id': '9e520e95-8061-41ca-ac43-b71b3ed126c0', 'serial': '9e520e95-8061-41ca-ac43-b71b3ed126c0'}, 'attachment_id': '80ec6ef9-66dd-4940-a0c7-4979b81d3476', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:29:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:29:36 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T19:29:16Z,direct_url=<?>,disk_format='qcow2',id=edb212e6-a11d-470b-ba78-a631129a6ee2,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1991169716',owner='48969fbade07485885e72fc3a2964678',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T19:29:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrvJSxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:29:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:29:36 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:29:36 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d03ef2b-7c44-4573-8e72-d03b584b0a8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:29:36 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da9903-3a3c-4fca-9d73-2f2bb506cf67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0] added
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36aec58-5359-40f4-8321-8bb5afb9a239]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56daab72-f477-4c40-8312-2ea61ef61ecc]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzrvJSxk {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzrvJSxk" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f6cdf4-b8d0-4fcc-a208-121e7c00890a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzrvJSxk'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[046fc283-a114-463f-bd77-9cba88c0ca42]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfd1e76-0464-45d6-b404-bc8c69d9a37a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8640b6ca-17cd-43cd-99df-2d530e77f90c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260]
Jul 31 19:29:36 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260] successful.
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52837b6-e264-43e1-b79d-34f2aa058a30]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d44bed-2233-427f-9a93-07af65525bc3]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:29:36 user nova-compute[72810]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:29:36 user nova-compute[72810]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)
Jul 31 19:29:36 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9521865c-7518-44be-a1d8-d20a5493cf8e]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrvJSxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:29:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23362646639633433', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362646639633433', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-593326719',id=48,image_ref='edb212e6-a11d-470b-ba78-a631129a6ee2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB7zZ5dw0h/ESup0+uCnHufRyraXbVBxmdLKVZsonNCRM+T6quYTv7KPvfWmlxX+88hegz/4aKDycM9wovujH18ZSEgPJ/ODzYpleoIDDqvX1iy9ElhSGGXXy21efu59w==',key_name='tempest-keypair-775633357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-y0guzgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1300522126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=333a49fa-6f05-4b8a-ba61-933c79857229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.objects.instance [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid 333a49fa-6f05-4b8a-ba61-933c79857229 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:29:37 user nova-compute[72810]:   <uuid>333a49fa-6f05-4b8a-ba61-933c79857229</uuid>
Jul 31 19:29:37 user nova-compute[72810]:   <name>instance-00000030</name>
Jul 31 19:29:37 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:29:37 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:29:37 user nova-compute[72810]:   <metadata>
Jul 31 19:29:37 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:29:37 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-593326719</nova:name>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:29:36</nova:creationTime>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:29:37 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:29:37 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:owner>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:29:37 user nova-compute[72810]:       </nova:owner>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:root type="image" uuid="edb212e6-a11d-470b-ba78-a631129a6ee2"/>
Jul 31 19:29:37 user nova-compute[72810]:       <nova:ports>
Jul 31 19:29:37 user nova-compute[72810]:         <nova:port uuid="60fa3946-7aaa-480c-9fd0-fd19a837e01f">
Jul 31 19:29:37 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 19:29:37 user nova-compute[72810]:         </nova:port>
Jul 31 19:29:37 user nova-compute[72810]:       </nova:ports>
Jul 31 19:29:37 user nova-compute[72810]:     </nova:instance>
Jul 31 19:29:37 user nova-compute[72810]:   </metadata>
Jul 31 19:29:37 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:29:37 user nova-compute[72810]:     <system>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="serial">333a49fa-6f05-4b8a-ba61-933c79857229</entry>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="uuid">333a49fa-6f05-4b8a-ba61-933c79857229</entry>
Jul 31 19:29:37 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:29:37 user nova-compute[72810]:     </system>
Jul 31 19:29:37 user nova-compute[72810]:   </sysinfo>
Jul 31 19:29:37 user nova-compute[72810]:   <os>
Jul 31 19:29:37 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:29:37 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:29:37 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:29:37 user nova-compute[72810]:   </os>
Jul 31 19:29:37 user nova-compute[72810]:   <features>
Jul 31 19:29:37 user nova-compute[72810]:     <acpi/>
Jul 31 19:29:37 user nova-compute[72810]:     <apic/>
Jul 31 19:29:37 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:29:37 user nova-compute[72810]:   </features>
Jul 31 19:29:37 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:29:37 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:29:37 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:29:37 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:29:37 user nova-compute[72810]:   </clock>
Jul 31 19:29:37 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:29:37 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:29:37 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:29:37 user nova-compute[72810]:   </cpu>
Jul 31 19:29:37 user nova-compute[72810]:   <devices>
Jul 31 19:29:37 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:29:37 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:29:37 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 19:29:37 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:29:37 user nova-compute[72810]:       <serial>9e520e95-8061-41ca-ac43-b71b3ed126c0</serial>
Jul 31 19:29:37 user nova-compute[72810]:     </disk>
Jul 31 19:29:37 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:29:37 user nova-compute[72810]:       <mac address="fa:16:3e:88:cd:d4"/>
Jul 31 19:29:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:29:37 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:29:37 user nova-compute[72810]:       <target dev="tap60fa3946-7a"/>
Jul 31 19:29:37 user nova-compute[72810]:     </interface>
Jul 31 19:29:37 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:29:37 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/333a49fa-6f05-4b8a-ba61-933c79857229/console.log" append="off"/>
Jul 31 19:29:37 user nova-compute[72810]:     </serial>
Jul 31 19:29:37 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:29:37 user nova-compute[72810]:     <video>
Jul 31 19:29:37 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:29:37 user nova-compute[72810]:     </video>
Jul 31 19:29:37 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:29:37 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:29:37 user nova-compute[72810]:     </rng>
Jul 31 19:29:37 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:29:37 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:29:37 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:29:37 user nova-compute[72810]:     </memballoon>
Jul 31 19:29:37 user nova-compute[72810]:   </devices>
Jul 31 19:29:37 user nova-compute[72810]: </domain>
Jul 31 19:29:37 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-593326719',id=48,image_ref='edb212e6-a11d-470b-ba78-a631129a6ee2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB7zZ5dw0h/ESup0+uCnHufRyraXbVBxmdLKVZsonNCRM+T6quYTv7KPvfWmlxX+88hegz/4aKDycM9wovujH18ZSEgPJ/ODzYpleoIDDqvX1iy9ElhSGGXXy21efu59w==',key_name='tempest-keypair-775633357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-y0guzgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1300522126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=333a49fa-6f05-4b8a-ba61-933c79857229,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG os_vif [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60fa3946-7a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60fa3946-7a, col_values=(('external_ids', {'iface-id': '60fa3946-7aaa-480c-9fd0-fd19a837e01f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:cd:d4', 'vm-uuid': '333a49fa-6f05-4b8a-ba61-933c79857229'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:37 user nova-compute[72810]: INFO os_vif [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a')
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:29:37 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:88:cd:d4, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:29:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:39 user nova-compute[72810]: DEBUG nova.compute.manager [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] No waiting events found dispatching network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:29:39 user nova-compute[72810]: WARNING nova.compute.manager [req-8538f7ef-7e0d-4e0f-a039-d76a56959626 req-640aef32-a1df-4bfb-9a6e-793032c9cbc9 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received unexpected event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f for instance with vm_state building and task_state spawning.
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831780.872625, 333a49fa-6f05-4b8a-ba61-933c79857229 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] VM Resumed (Lifecycle Event)
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Instance spawned successfully.
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690831780.8744066, 333a49fa-6f05-4b8a-ba61-933c79857229 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] VM Started (Lifecycle Event)
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Took 4.86 seconds to spawn the instance on the hypervisor.
Jul 31 19:29:40 user nova-compute[72810]: DEBUG nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:29:40 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:29:41 user nova-compute[72810]: INFO nova.compute.manager [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Took 18.45 seconds to build instance.
Jul 31 19:29:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-edb19402-2d78-4237-8b64-a383984f1545 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.569s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:29:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:41 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:41 user nova-compute[72810]: DEBUG nova.compute.manager [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] No waiting events found dispatching network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:29:41 user nova-compute[72810]: WARNING nova.compute.manager [req-f17c8e36-5d63-4c6e-8c3f-237b1d2a9658 req-b5007e90-e706-48cf-abb5-13be85f306eb service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received unexpected event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f for instance with vm_state active and task_state None.
Jul 31 19:29:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:29:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:29:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:29:52 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.19281768798828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 333a49fa-6f05-4b8a-ba61-933c79857229 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:29:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:29:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:29:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:29:58 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:29:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:30:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:30:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:04 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:30:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:30:04 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:30:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:30:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:30:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:30:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:30:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.192161560058594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 333a49fa-6f05-4b8a-ba61-933c79857229 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:53 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:30:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:30:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:30:59 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating instance_info_cache with network_info: [{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:31:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:31:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-changed-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.compute.manager [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Refreshing instance network info cache due to event network-changed-60fa3946-7aaa-480c-9fd0-fd19a837e01f. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] Acquiring lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] Acquired lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Refreshing network info cache for port 60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updated VIF entry in instance network info cache for port 60fa3946-7aaa-480c-9fd0-fd19a837e01f. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.network.neutron [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating instance_info_cache with network_info: [{"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bfede974-a3e8-481d-ad25-6889af5ab7dc req-aab705ff-675e-4149-9db8-11aa20c9a46c service nova] Releasing lock "refresh_cache-333a49fa-6f05-4b8a-ba61-933c79857229" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:14 user nova-compute[72810]: INFO nova.compute.manager [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Terminating instance
Jul 31 19:31:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-unplugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] No waiting events found dispatching network-vif-unplugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.compute.manager [req-1504972a-3e57-4ab8-bf21-241bdf040462 req-0a64de74-a88c-4639-af1a-5eb6b5932cf5 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-unplugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Instance destroyed successfully.
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid 333a49fa-6f05-4b8a-ba61-933c79857229 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:29:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-593326719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-593326719',id=48,image_ref='edb212e6-a11d-470b-ba78-a631129a6ee2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB7zZ5dw0h/ESup0+uCnHufRyraXbVBxmdLKVZsonNCRM+T6quYTv7KPvfWmlxX+88hegz/4aKDycM9wovujH18ZSEgPJ/ODzYpleoIDDqvX1iy9ElhSGGXXy21efu59w==',key_name='tempest-keypair-775633357',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-y0guzgjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1300522126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=333a49fa-6f05-4b8a-ba61-933c79857229,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "address": "fa:16:3e:88:cd:d4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60fa3946-7a", "ovs_interfaceid": "60fa3946-7aaa-480c-9fd0-fd19a837e01f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_vif [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60fa3946-7a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:15 user nova-compute[72810]: INFO os_vif [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:cd:d4,bridge_name='br-int',has_traffic_filtering=True,id=60fa3946-7aaa-480c-9fd0-fd19a837e01f,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60fa3946-7a')
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzrvJSxk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:31:15 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c32e8f-6c56-49d7-a86f-c3b96f605c9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[922ff02f-c5de-4589-ac95-ccacff7169b8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:31:15 user nova-compute[72810]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)
Jul 31 19:31:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:31:15 user nova-compute[72810]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 (non-flash)
Jul 31 19:31:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc1240d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c72d53-bee6-4018-9790-18d76af55bfd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7642a-7d33-499b-92d5-9d963a0f7677]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[987bae66-dfa8-4bf1-946d-a460252114d4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a946b919-c4df-419e-a94a-5fc6ded809a9]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3eb43-348b-4aab-9065-f22d507a0c05]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08e2398-5e1b-433c-981a-e93d9238301c]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260]
Jul 31 19:31:15 user nova-compute[72810]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0, portal: 172.16.0.220,3260] successful.
Jul 31 19:31:15 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e520e95-8061-41ca-ac43-b71b3ed126c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff822c-91a0-4efb-88e9-4c227478eee0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (273ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:31:15 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Deleting instance files /opt/stack/data/nova/instances/333a49fa-6f05-4b8a-ba61-933c79857229_del
Jul 31 19:31:15 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Deletion of /opt/stack/data/nova/instances/333a49fa-6f05-4b8a-ba61-933c79857229_del complete
Jul 31 19:31:15 user nova-compute[72810]: INFO nova.compute.manager [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Took 1.12 seconds to destroy the instance on the hypervisor.
Jul 31 19:31:15 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:31:15 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:31:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:31:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] Acquiring lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] Lock "333a49fa-6f05-4b8a-ba61-933c79857229-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] No waiting events found dispatching network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:31:17 user nova-compute[72810]: WARNING nova.compute.manager [req-56dd5de5-f495-4120-a61e-08ad642a97c6 req-bad2a1d0-4750-49d1-b6af-13cb2cd8c440 service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received unexpected event network-vif-plugged-60fa3946-7aaa-480c-9fd0-fd19a837e01f for instance with vm_state active and task_state deleting.
Jul 31 19:31:17 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:31:17 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Took 1.32 seconds to deallocate network for instance.
Jul 31 19:31:17 user nova-compute[72810]: DEBUG nova.compute.manager [req-504cf990-d95e-4055-9b80-f48fb6ad3ed3 req-88834cf5-c0cb-41b9-abfb-932f5a20b9ae service nova] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Received event network-vif-deleted-60fa3946-7aaa-480c-9fd0-fd19a837e01f {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:31:18 user nova-compute[72810]: INFO nova.compute.manager [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Took 0.72 seconds to detach 1 volumes for instance.
Jul 31 19:31:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Deleting volume: 9e520e95-8061-41ca-ac43-b71b3ed126c0 {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 19:31:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:18 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:31:18 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:31:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:18 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance 333a49fa-6f05-4b8a-ba61-933c79857229
Jul 31 19:31:18 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d217751a-c586-4815-84bb-ae78b2da0ad4 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "333a49fa-6f05-4b8a-ba61-933c79857229" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.613s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:28 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:31:28 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:31:30 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690831875.6037138, 333a49fa-6f05-4b8a-ba61-933c79857229 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:31:30 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] VM Stopped (Lifecycle Event)
Jul 31 19:31:30 user nova-compute[72810]: DEBUG nova.compute.manager [None req-18787fc2-fd13-4b0b-a676-8042cf284f57 None None] [instance: 333a49fa-6f05-4b8a-ba61-933c79857229] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:31:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:31:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:31:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:31:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:31:53 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.19125747680664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:31:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:31:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:32:07 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [{"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.295s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:08 user nova-compute[72810]: INFO nova.compute.manager [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Terminating instance
Jul 31 19:32:08 user nova-compute[72810]: DEBUG nova.compute.manager [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-unplugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] No waiting events found dispatching network-vif-unplugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.compute.manager [req-026c7eea-0349-4d0d-a9e4-3b8fa952691f req-633cfe81-7f56-4a86-ab21-3b144489cbd2 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-unplugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:32:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Instance destroyed successfully.
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.objects.instance [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:27:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1202235357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1202235357',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyo4q9R1kg+cC+8SX8a4KV3ktMuQkhUXmGaz9sk9holz2OVPwrtxsIzGQ20FbR1mEKDBUvpEMGq1WFfrYIigxjrbP5qvLJ06Wiv9aVfMxDp2iFY20feq4mrC1QjQQz6Yw==',key_name='tempest-keypair-2022510686',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:27:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-v3z0tg4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=90cfeb79-96d7-4f67-9cdb-19c19bafe3f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "address": "fa:16:3e:fc:b8:c4", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71eb14d9-5e", "ovs_interfaceid": "71eb14d9-5ea8-4294-893e-91bb33dd2a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_vif [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71eb14d9-5e, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:09 user nova-compute[72810]: INFO os_vif [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b8:c4,bridge_name='br-int',has_traffic_filtering=True,id=71eb14d9-5ea8-4294-893e-91bb33dd2a46,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71eb14d9-5e')
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BPyNbnCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:32:09 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9e4d20-a9dc-4421-89b3-a0ff086e9aa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79b425-0bc4-471e-8d09-b5d95fca894f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:32:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d (non-flash)
Jul 31 19:32:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec381d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[959473c5-7b03-41a9-8910-579588369313]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a234396-4e1e-4cfe-9e66-d5242a16c993]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ffa490-37a3-4d8b-ad93-a095b987bac2]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[757deee9-2f67-4859-ac58-ac12e9de4b34]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_36e5460e', '/dev/disk/by-id/scsi-26464346161653363', '/dev/disk/by-id/scsi-1SCST_BIO36e5460e-dd4aae3c6059291f') {{(pid=84119) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3131093a-2dfd-4e83-b626-2528f48c5ebe]: (4, None) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27aee73-523c-4c0f-a010-bd6f562d6c58]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1b30af-2e2e-4268-8519-ea6c0d4109c7]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260]
Jul 31 19:32:09 user nova-compute[72810]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d, portal: 172.16.0.220,3260] successful.
Jul 31 19:32:09 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20cbc4aa-0015-4694-98d7-eb75c6d5c07d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[396a3b8b-3626-46ab-9f22-ed0cee62d4e8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (270ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:32:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Deleting instance files /opt/stack/data/nova/instances/90cfeb79-96d7-4f67-9cdb-19c19bafe3f5_del
Jul 31 19:32:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Deletion of /opt/stack/data/nova/instances/90cfeb79-96d7-4f67-9cdb-19c19bafe3f5_del complete
Jul 31 19:32:09 user nova-compute[72810]: INFO nova.compute.manager [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 19:32:09 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:32:09 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:32:10 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:32:10 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Took 0.98 seconds to deallocate network for instance.
Jul 31 19:32:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-eb9aa38c-5791-4dfd-9972-e1a61e764771 req-d181b70e-b3c5-4425-913a-d333c0456da1 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-deleted-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] Acquiring lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] No waiting events found dispatching network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:32:11 user nova-compute[72810]: WARNING nova.compute.manager [req-4e3f9990-7260-406a-ab30-fadb863d289b req-570fb400-a905-471a-b42a-0dfe9ff7e313 service nova] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Received unexpected event network-vif-plugged-71eb14d9-5ea8-4294-893e-91bb33dd2a46 for instance with vm_state active and task_state deleting.
Jul 31 19:32:11 user nova-compute[72810]: INFO nova.compute.manager [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 19:32:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Deleting volume: 20cbc4aa-0015-4694-98d7-eb75c6d5c07d {{(pid=72810) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:32:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:11 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5
Jul 31 19:32:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-900ddd6d-baa2-421b-94bf-36219e72c77d tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "90cfeb79-96d7-4f67-9cdb-19c19bafe3f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.502s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690831929.5767484, 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:32:24 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] VM Stopped (Lifecycle Event)
Jul 31 19:32:24 user nova-compute[72810]: DEBUG nova.compute.manager [None req-1b358ff8-0126-46a5-9acc-4fb9f09bb3da None None] [instance: 90cfeb79-96d7-4f67-9cdb-19c19bafe3f5] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:32:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:54 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:32:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:32:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8923MB free_disk=25.190383911132812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:32:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:32:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:32:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:33:09 user nova-compute[72810]: INFO nova.compute.claims [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Claim successful on node user
Jul 31 19:33:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Skipping network cache update for instance because it is Building. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:33:09 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:33:09 user nova-compute[72810]: INFO nova.virt.block_device [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Booting with volume c7e7465b-1b82-402b-955c-61152c1ef406 at /dev/vda
Jul 31 19:33:09 user nova-compute[72810]: DEBUG nova.policy [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.utils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[16589623-443f-4f36-89f2-1345fafc1ca8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[328fb539-da47-4e57-9563-fe386f5af769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd52623-98d2-499b-ad8c-50119d65b463]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[61231b3d-bb18-4bb8-97fd-d188ba9015fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:33:10 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:33:10 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb198f9-2c86-44b9-8714-38ddafa420e8]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG os_brick.utils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating existing volume attachment record: 8a51cce2-1ca3-4b18-8734-c02133a43722 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:33:10 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Successfully created port: b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Successfully updated port: b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-changed-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.compute.manager [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Refreshing instance network info cache due to event network-changed-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] Acquiring lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating instance_info_cache with network_info: [{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Instance network_info: |[{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] Acquired lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:33:11 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Refreshing network info cache for port b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:33:12 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updated VIF entry in instance network info cache for port b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:33:12 user nova-compute[72810]: DEBUG nova.network.neutron [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating instance_info_cache with network_info: [{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:33:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-bf11c490-ada6-4580-9fb8-efd247599c04 req-a6f53de5-778f-47ee-a79b-1a811ee358e0 service nova] Releasing lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:33:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:33:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:33:17 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Creating image(s)
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Ensure instance console log exists: /opt/stack/data/nova/instances/3645b9da-b979-4c15-ada5-f583976fb2d6/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Start _get_guest_xml network_info=[{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3645b9da-b979-4c15-ada5-f583976fb2d6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7e7465b-1b82-402b-955c-61152c1ef406', 'serial': 'c7e7465b-1b82-402b-955c-61152c1ef406'}, 'attachment_id': '8a51cce2-1ca3-4b18-8734-c02133a43722', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:33:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:33:17 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:33:17 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:33:17 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:33:17 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eed255f-4051-4f91-be51-67635abfcee3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:33:17 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa285f-fd50-4117-a276-c0b615e55a43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406] added
Jul 31 19:33:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37483f-5a18-4b30-accb-c7b74833c0e4]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5dc497-ae48-4664-9036-badfffb9d833]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XquFsBxI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XquFsBxI" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa716d5-18e2-48b4-8d4f-1933da48463c]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XquFsBxI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92b6be5-2eb9-4b4f-bac8-938c235369b1]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce1047-6954-489d-a1a9-20d0e1c99ae4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:33:17 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:33:17 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:33:17 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:33:17 user nova-compute[72810]: 
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e3abc2-54ef-4263-bdc4-97a043e1097a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]
Jul 31 19:33:17 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.
Jul 31 19:33:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e538215e-0c6c-4c22-a4b8-88fca22f6a70]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[709bf16a-33c5-4467-a368-6affc7317e9a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:33:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:33:17 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962860b-ec67-4cb9-8f90-3ab56ed3c497]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:33:17 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26534366636313134', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534366636313134', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38098987',display_name='tempest-TestVolumeBootPattern-server-38098987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38098987',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-dgi7w6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:33:10Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=3645b9da-b979-4c15-ada5-f583976fb2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.objects.instance [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid 3645b9da-b979-4c15-ada5-f583976fb2d6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:33:18 user nova-compute[72810]:   <uuid>3645b9da-b979-4c15-ada5-f583976fb2d6</uuid>
Jul 31 19:33:18 user nova-compute[72810]:   <name>instance-00000031</name>
Jul 31 19:33:18 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:33:18 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:33:18 user nova-compute[72810]:   <metadata>
Jul 31 19:33:18 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:33:18 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:33:18 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-server-38098987</nova:name>
Jul 31 19:33:18 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:33:17</nova:creationTime>
Jul 31 19:33:18 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:33:18 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:33:18 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:33:18 user nova-compute[72810]:       <nova:owner>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:33:18 user nova-compute[72810]:       </nova:owner>
Jul 31 19:33:18 user nova-compute[72810]:       <nova:ports>
Jul 31 19:33:18 user nova-compute[72810]:         <nova:port uuid="b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c">
Jul 31 19:33:18 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 19:33:18 user nova-compute[72810]:         </nova:port>
Jul 31 19:33:18 user nova-compute[72810]:       </nova:ports>
Jul 31 19:33:18 user nova-compute[72810]:     </nova:instance>
Jul 31 19:33:18 user nova-compute[72810]:   </metadata>
Jul 31 19:33:18 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:33:18 user nova-compute[72810]:     <system>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="serial">3645b9da-b979-4c15-ada5-f583976fb2d6</entry>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="uuid">3645b9da-b979-4c15-ada5-f583976fb2d6</entry>
Jul 31 19:33:18 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:33:18 user nova-compute[72810]:     </system>
Jul 31 19:33:18 user nova-compute[72810]:   </sysinfo>
Jul 31 19:33:18 user nova-compute[72810]:   <os>
Jul 31 19:33:18 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:33:18 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:33:18 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:33:18 user nova-compute[72810]:   </os>
Jul 31 19:33:18 user nova-compute[72810]:   <features>
Jul 31 19:33:18 user nova-compute[72810]:     <acpi/>
Jul 31 19:33:18 user nova-compute[72810]:     <apic/>
Jul 31 19:33:18 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:33:18 user nova-compute[72810]:   </features>
Jul 31 19:33:18 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:33:18 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:33:18 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:33:18 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:33:18 user nova-compute[72810]:   </clock>
Jul 31 19:33:18 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:33:18 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:33:18 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:33:18 user nova-compute[72810]:   </cpu>
Jul 31 19:33:18 user nova-compute[72810]:   <devices>
Jul 31 19:33:18 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:33:18 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:33:18 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 19:33:18 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:33:18 user nova-compute[72810]:       <serial>c7e7465b-1b82-402b-955c-61152c1ef406</serial>
Jul 31 19:33:18 user nova-compute[72810]:     </disk>
Jul 31 19:33:18 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:33:18 user nova-compute[72810]:       <mac address="fa:16:3e:54:1f:4c"/>
Jul 31 19:33:18 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:33:18 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:33:18 user nova-compute[72810]:       <target dev="tapb23ba631-6a"/>
Jul 31 19:33:18 user nova-compute[72810]:     </interface>
Jul 31 19:33:18 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:33:18 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/3645b9da-b979-4c15-ada5-f583976fb2d6/console.log" append="off"/>
Jul 31 19:33:18 user nova-compute[72810]:     </serial>
Jul 31 19:33:18 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:33:18 user nova-compute[72810]:     <video>
Jul 31 19:33:18 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:33:18 user nova-compute[72810]:     </video>
Jul 31 19:33:18 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:33:18 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:33:18 user nova-compute[72810]:     </rng>
Jul 31 19:33:18 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:33:18 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:33:18 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:33:18 user nova-compute[72810]:     </memballoon>
Jul 31 19:33:18 user nova-compute[72810]:   </devices>
Jul 31 19:33:18 user nova-compute[72810]: </domain>
Jul 31 19:33:18 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38098987',display_name='tempest-TestVolumeBootPattern-server-38098987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38098987',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-dgi7w6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:33:10Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=3645b9da-b979-4c15-ada5-f583976fb2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG os_vif [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb23ba631-6a, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb23ba631-6a, col_values=(('external_ids', {'iface-id': 'b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:1f:4c', 'vm-uuid': '3645b9da-b979-4c15-ada5-f583976fb2d6'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:18 user nova-compute[72810]: INFO os_vif [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a')
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:33:18 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:54:1f:4c, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:33:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG nova.compute.manager [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] No waiting events found dispatching network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:33:20 user nova-compute[72810]: WARNING nova.compute.manager [req-8b7b5bf4-9049-4429-ad74-041d637ad7e1 req-13b15b49-62f7-4ae1-8eab-1dd70a86ca2b service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received unexpected event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c for instance with vm_state building and task_state spawning.
Jul 31 19:33:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832002.0190356, 3645b9da-b979-4c15-ada5-f583976fb2d6 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] VM Resumed (Lifecycle Event)
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Instance spawned successfully.
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832002.0201867, 3645b9da-b979-4c15-ada5-f583976fb2d6 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] VM Started (Lifecycle Event)
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Took 4.89 seconds to spawn the instance on the hypervisor.
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:33:22 user nova-compute[72810]: INFO nova.compute.manager [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Took 12.71 seconds to build instance.
Jul 31 19:33:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-3ef4d483-43ce-4744-b3a8-305ad769ca5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.801s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:22 user nova-compute[72810]: DEBUG nova.compute.manager [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] No waiting events found dispatching network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:33:22 user nova-compute[72810]: WARNING nova.compute.manager [req-48ce664b-16ac-41d1-b440-522939a68526 req-c2078510-1eb2-43b3-9282-26bcb245edf1 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received unexpected event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c for instance with vm_state active and task_state None.
Jul 31 19:33:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:33:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:33:54 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:33:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:33:55 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=25.1881103515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 3645b9da-b979-4c15-ada5-f583976fb2d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:33:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:33:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:34:10 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 3645b9da-b979-4c15-ada5-f583976fb2d6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:34:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating instance_info_cache with network_info: [{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:34:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:34:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:34:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:54 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:34:55 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:34:56 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:34:56 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.187515258789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 3645b9da-b979-4c15-ada5-f583976fb2d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:34:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:34:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-changed-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG nova.compute.manager [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Refreshing instance network info cache due to event network-changed-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] Acquiring lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] Acquired lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG nova.network.neutron [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Refreshing network info cache for port b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:02 user nova-compute[72810]: INFO nova.compute.manager [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Terminating instance
Jul 31 19:35:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.network.neutron [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updated VIF entry in instance network info cache for port b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.network.neutron [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating instance_info_cache with network_info: [{"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c2457111-37dd-4056-be54-11430552ec5e req-e6577d6b-3909-442a-9ca8-6a87a8d5a568 service nova] Releasing lock "refresh_cache-3645b9da-b979-4c15-ada5-f583976fb2d6" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-unplugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] No waiting events found dispatching network-vif-unplugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.compute.manager [req-ba160eb8-87b0-40a7-a56b-964157d7a5b5 req-5973b170-a032-482e-9ed1-fc7b4edddb86 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-unplugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:35:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Instance destroyed successfully.
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid 3645b9da-b979-4c15-ada5-f583976fb2d6 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-38098987',display_name='tempest-TestVolumeBootPattern-server-38098987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-38098987',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:33:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-dgi7w6tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:33:22Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=3645b9da-b979-4c15-ada5-f583976fb2d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "address": "fa:16:3e:54:1f:4c", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23ba631-6a", "ovs_interfaceid": "b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_vif [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb23ba631-6a, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:35:03 user nova-compute[72810]: INFO os_vif [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:1f:4c,bridge_name='br-int',has_traffic_filtering=True,id=b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23ba631-6a')
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:35:03 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda8f779-e891-490a-949a-36c476f2b0f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e763d726-377d-45eb-8f22-6cf0a300102c]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:35:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:35:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec0fd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b46a8-8d3e-4e34-9ccf-2891140f1be3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[56127c34-f922-4927-82c3-afe159587ef8]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f8074-11de-4655-81be-de4b7523c03d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d739478-33da-4fcb-b606-b05b185a2d52]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO629bfe4a-e46f611491fb60c9', '/dev/disk/by-id/scsi-26534366636313134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_629bfe4a') {{(pid=84119) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b2786-95e3-40a5-9bae-a21eb3855c00]: (4, None) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[70065532-f694-44d9-897e-411967527949]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5838c63b-3baa-4f91-a8f5-6838fd27f509]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]
Jul 31 19:35:03 user nova-compute[72810]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.
Jul 31 19:35:03 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ce876-29aa-4d6b-ba47-459220a68d96]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (278ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:35:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:35:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Deleting instance files /opt/stack/data/nova/instances/3645b9da-b979-4c15-ada5-f583976fb2d6_del
Jul 31 19:35:03 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Deletion of /opt/stack/data/nova/instances/3645b9da-b979-4c15-ada5-f583976fb2d6_del complete
Jul 31 19:35:04 user nova-compute[72810]: INFO nova.compute.manager [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Took 1.10 seconds to destroy the instance on the hypervisor.
Jul 31 19:35:04 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:35:04 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:35:04 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:35:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:35:05 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Took 1.03 seconds to deallocate network for instance.
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-e1f05b52-ec8f-4dbd-a3c5-37bf358a72b3 req-0b3bb0db-e533-471d-b883-4fdecfb75292 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-deleted-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] Acquiring lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] No waiting events found dispatching network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:35:05 user nova-compute[72810]: WARNING nova.compute.manager [req-d7213b48-b922-4090-9e10-aa7c6b695776 req-e2002e0f-eac1-436a-afc1-c23042b77665 service nova] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Received unexpected event network-vif-plugged-b23ba631-6a40-4c7f-9dbe-dc6044c1cc6c for instance with vm_state active and task_state deleting.
Jul 31 19:35:05 user nova-compute[72810]: INFO nova.compute.manager [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Took 0.70 seconds to detach 1 volumes for instance.
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:35:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:05 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance 3645b9da-b979-4c15-ada5-f583976fb2d6
Jul 31 19:35:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-008c3331-691e-485d-841d-83cafc56bf5f tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "3645b9da-b979-4c15-ada5-f583976fb2d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.115s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:08 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:35:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:35:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:35:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690832103.6675727, 3645b9da-b979-4c15-ada5-f583976fb2d6 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:35:18 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] VM Stopped (Lifecycle Event)
Jul 31 19:35:18 user nova-compute[72810]: DEBUG nova.compute.manager [None req-30d149c6-fc1a-4515-9a59-a6e98ac0fe22 None None] [instance: 3645b9da-b979-4c15-ada5-f583976fb2d6] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:35:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:54 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:35:54 user nova-compute[72810]: INFO nova.compute.claims [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Claim successful on node user
Jul 31 19:35:54 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.180s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:35:55 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:35:55 user nova-compute[72810]: INFO nova.virt.block_device [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Booting with volume c7e7465b-1b82-402b-955c-61152c1ef406 at /dev/vda
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.policy [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.utils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa42b778-cd12-4a37-a288-110c57998c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ad848-2e88-40b5-bdaa-ebe3950f5121]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f951be-a857-44c5-b0f6-227b4b23ece7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[f125920a-2bfc-4928-b219-9c0bd7254fe4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:35:55 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[201818b4-1a46-4220-a5d1-9c8f7871a3c4]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG os_brick.utils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating existing volume attachment record: 66360ea0-1829-43f9-a85b-968df727ce20 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:55 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Successfully created port: 2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:56 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:35:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:35:57 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.178543090820312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 93d13ccf-1d94-437e-8480-5d2301488654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Successfully updated port: 2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.manager [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing instance network info cache due to event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.network.neutron [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Instance network_info: |[{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:35:57 user nova-compute[72810]: DEBUG nova.network.neutron [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:35:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated VIF entry in instance network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:35:58 user nova-compute[72810]: DEBUG nova.network.neutron [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:35:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-e29f5197-f684-423b-a3bd-6a31fdea00c7 req-811741cc-8628-4564-96e0-3b61d3687711 service nova] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:35:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:36:02 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Creating image(s)
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Ensure instance console log exists: /opt/stack/data/nova/instances/93d13ccf-1d94-437e-8480-5d2301488654/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Start _get_guest_xml network_info=[{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '93d13ccf-1d94-437e-8480-5d2301488654', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7e7465b-1b82-402b-955c-61152c1ef406', 'serial': 'c7e7465b-1b82-402b-955c-61152c1ef406'}, 'attachment_id': '66360ea0-1829-43f9-a85b-968df727ce20', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:36:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:36:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:36:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:36:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:36:02 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc1937-81ff-42bd-8ce0-e9abf6b83d8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:36:02 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da7d8b3-9cb9-42e2-9a53-5c63b5ac985a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406] added
Jul 31 19:36:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d94cc-1970-4e12-af58-73d11667a1a0]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a27ec-cbb3-4b52-90c6-33079f981bb3]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XquFsBxI {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XquFsBxI" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d9b2a-17c1-4256-8ce8-73878a71e219]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XquFsBxI'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa932a2-ba5a-4ef9-834d-2a43326bbde5]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acfdeb6-1516-48f3-9015-7c8e91550a5a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:36:02 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 19:36:02 user nova-compute[72810]:  {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:36:02 user nova-compute[72810]: WARNING os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 19:36:02 user nova-compute[72810]: 
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa1b8e2-42a3-4fd2-b896-b0cd3452e0fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]
Jul 31 19:36:02 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.
Jul 31 19:36:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfccb4c-a66a-43ef-970e-a7b904ae1c6f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21b936-bae4-4534-a2b7-5ca02ec9e043]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:36:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:36:02 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c7bc50-3fb9-4345-9b33-3d2ffaf66edb]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:36:02 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26534366636313134', 'path': '/dev/sdb'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534366636313134', 'path': '/dev/sdb'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1812938694',display_name='tempest-TestVolumeBootPattern-server-1812938694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1812938694',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-0080ebvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:35:55Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=93d13ccf-1d94-437e-8480-5d2301488654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.objects.instance [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:36:03 user nova-compute[72810]:   <uuid>93d13ccf-1d94-437e-8480-5d2301488654</uuid>
Jul 31 19:36:03 user nova-compute[72810]:   <name>instance-00000032</name>
Jul 31 19:36:03 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:36:03 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:36:03 user nova-compute[72810]:   <metadata>
Jul 31 19:36:03 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:36:03 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:36:03 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-server-1812938694</nova:name>
Jul 31 19:36:03 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:36:02</nova:creationTime>
Jul 31 19:36:03 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:36:03 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:36:03 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:36:03 user nova-compute[72810]:       <nova:owner>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:36:03 user nova-compute[72810]:       </nova:owner>
Jul 31 19:36:03 user nova-compute[72810]:       <nova:ports>
Jul 31 19:36:03 user nova-compute[72810]:         <nova:port uuid="2f7ac1f2-2440-4a82-a998-bef8a08645b3">
Jul 31 19:36:03 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 19:36:03 user nova-compute[72810]:         </nova:port>
Jul 31 19:36:03 user nova-compute[72810]:       </nova:ports>
Jul 31 19:36:03 user nova-compute[72810]:     </nova:instance>
Jul 31 19:36:03 user nova-compute[72810]:   </metadata>
Jul 31 19:36:03 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:36:03 user nova-compute[72810]:     <system>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="serial">93d13ccf-1d94-437e-8480-5d2301488654</entry>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="uuid">93d13ccf-1d94-437e-8480-5d2301488654</entry>
Jul 31 19:36:03 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:36:03 user nova-compute[72810]:     </system>
Jul 31 19:36:03 user nova-compute[72810]:   </sysinfo>
Jul 31 19:36:03 user nova-compute[72810]:   <os>
Jul 31 19:36:03 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:36:03 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:36:03 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:36:03 user nova-compute[72810]:   </os>
Jul 31 19:36:03 user nova-compute[72810]:   <features>
Jul 31 19:36:03 user nova-compute[72810]:     <acpi/>
Jul 31 19:36:03 user nova-compute[72810]:     <apic/>
Jul 31 19:36:03 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:36:03 user nova-compute[72810]:   </features>
Jul 31 19:36:03 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:36:03 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:36:03 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:36:03 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:36:03 user nova-compute[72810]:   </clock>
Jul 31 19:36:03 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:36:03 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:36:03 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:36:03 user nova-compute[72810]:   </cpu>
Jul 31 19:36:03 user nova-compute[72810]:   <devices>
Jul 31 19:36:03 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:36:03 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:36:03 user nova-compute[72810]:       <source dev="/dev/sdb"/>
Jul 31 19:36:03 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:36:03 user nova-compute[72810]:       <serial>c7e7465b-1b82-402b-955c-61152c1ef406</serial>
Jul 31 19:36:03 user nova-compute[72810]:     </disk>
Jul 31 19:36:03 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:36:03 user nova-compute[72810]:       <mac address="fa:16:3e:42:82:89"/>
Jul 31 19:36:03 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:36:03 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:36:03 user nova-compute[72810]:       <target dev="tap2f7ac1f2-24"/>
Jul 31 19:36:03 user nova-compute[72810]:     </interface>
Jul 31 19:36:03 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:36:03 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/93d13ccf-1d94-437e-8480-5d2301488654/console.log" append="off"/>
Jul 31 19:36:03 user nova-compute[72810]:     </serial>
Jul 31 19:36:03 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:36:03 user nova-compute[72810]:     <video>
Jul 31 19:36:03 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:36:03 user nova-compute[72810]:     </video>
Jul 31 19:36:03 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:36:03 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:36:03 user nova-compute[72810]:     </rng>
Jul 31 19:36:03 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:36:03 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:36:03 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:36:03 user nova-compute[72810]:     </memballoon>
Jul 31 19:36:03 user nova-compute[72810]:   </devices>
Jul 31 19:36:03 user nova-compute[72810]: </domain>
Jul 31 19:36:03 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1812938694',display_name='tempest-TestVolumeBootPattern-server-1812938694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1812938694',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-0080ebvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:35:55Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=93d13ccf-1d94-437e-8480-5d2301488654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG os_vif [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f7ac1f2-24, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f7ac1f2-24, col_values=(('external_ids', {'iface-id': '2f7ac1f2-2440-4a82-a998-bef8a08645b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:82:89', 'vm-uuid': '93d13ccf-1d94-437e-8480-5d2301488654'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:03 user nova-compute[72810]: INFO os_vif [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24')
Jul 31 19:36:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:36:04 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:42:82:89, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG nova.compute.manager [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] No waiting events found dispatching network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:36:05 user nova-compute[72810]: WARNING nova.compute.manager [req-c3c7974c-f677-447d-a394-256c26f32c08 req-5b337f0a-6922-461d-b9a5-b85bea9cd83f service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received unexpected event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 for instance with vm_state building and task_state spawning.
Jul 31 19:36:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832167.5040386, 93d13ccf-1d94-437e-8480-5d2301488654 => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] VM Resumed (Lifecycle Event)
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Instance spawned successfully.
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832167.5043497, 93d13ccf-1d94-437e-8480-5d2301488654 => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] VM Started (Lifecycle Event)
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Took 5.10 seconds to spawn the instance on the hypervisor.
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:36:07 user nova-compute[72810]: INFO nova.compute.manager [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Took 12.90 seconds to build instance.
Jul 31 19:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-9c1e9112-847e-46ea-b952-db891a7d3ecc tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.991s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:07 user nova-compute[72810]: DEBUG nova.compute.manager [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] No waiting events found dispatching network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:36:07 user nova-compute[72810]: WARNING nova.compute.manager [req-289bf945-0f96-4ab6-832e-d8ebb0b77e96 req-5e77ded1-1e89-454a-a9c3-f0471a8a4285 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received unexpected event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 for instance with vm_state active and task_state None.
Jul 31 19:36:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:36:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:36:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:36:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:13 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:18 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:18 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:21 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:23 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:28 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:33 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:38 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:39 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:36:39 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:36:43 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:53 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Triggering sync for uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "93d13ccf-1d94-437e-8480-5d2301488654" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:56 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "93d13ccf-1d94-437e-8480-5d2301488654" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:36:57 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:36:58 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:36:58 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.177059173583984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 93d13ccf-1d94-437e-8480-5d2301488654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:36:58 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:02 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:03 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:05 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:09 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:37:10 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:37:11 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:37:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:37:11 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:37:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:37:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:20 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:37:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:37:44 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:37:46 user nova-compute[72810]: DEBUG nova.compute.manager [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing instance network info cache due to event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:37:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:37:46 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:37:46 user nova-compute[72810]: DEBUG nova.network.neutron [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:37:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated VIF entry in instance network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:37:47 user nova-compute[72810]: DEBUG nova.network.neutron [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:37:47 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-91b71d01-af7c-4091-b281-3d507e29c01a req-bdc896f7-8824-4b4d-b51d-610184eb61e5 service nova] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:37:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:37:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:37:57 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:37:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Starting instance... {{(pid=72810) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72810) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 19:37:58 user nova-compute[72810]: INFO nova.compute.claims [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Claim successful on node user
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Start building networks asynchronously for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Allocating IP information in the background. {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] allocate_for_instance() {{(pid=72810) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 19:37:58 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Start building block device mappings for instance. {{(pid=72810) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 19:37:58 user nova-compute[72810]: INFO nova.virt.block_device [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Booting with volume b183adb8-6d4a-493a-97fc-04ca35b83515 at /dev/vda
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.utils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[beebbd93-4473-48bf-b2bf-4a44ab830dfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b927278e24dc\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.policy [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5faf892d5f364c9b83e6f9983c7725cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48969fbade07485885e72fc3a2964678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72810) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa62d8b-1789-473e-8e83-4e9b8dd52d94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0b8bd5-73e4-4c47-81dd-1859f1e64104]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e400ef-7665-4aaa-a823-6764973c7967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Running cmd (subprocess): nvme version {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72810) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] nvme not present on system {{(pid=72810) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 19:37:58 user nova-compute[72810]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[48580c6b-f079-4d15-8f7a-4002493ec6d3]: (4, '') {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72810) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.lightos [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] LIGHTOS: no hostnqn found. {{(pid=72810) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG os_brick.utils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b927278e24dc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.virt.block_device [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating existing volume attachment record: 683effdd-2700-496c-b333-84b3d20671b9 {{(pid=72810) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:37:58 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:37:59 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:37:59 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.175994873046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Successfully created port: e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 93d13ccf-1d94-437e-8480-5d2301488654 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8cf9ea90-02ff-4772-836b-aa512c5a2a0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:37:59 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Successfully updated port: e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquired lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Building network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Instance cache missing network info. {{(pid=72810) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.compute.manager [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing instance network info cache due to event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] Acquiring lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.network.neutron [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Releasing lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Instance network_info: |[{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72810) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] Acquired lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:38:00 user nova-compute[72810]: DEBUG nova.network.neutron [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:38:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updated VIF entry in instance network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:38:01 user nova-compute[72810]: DEBUG nova.network.neutron [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:38:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-349c0d3f-8293-4059-a345-7bd54fbe2499 req-d909ea0b-ef5a-4aaf-9308-23946dbe8714 service nova] Releasing lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:38:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:04 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:04 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Start spawning the instance on the hypervisor. {{(pid=72810) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Creating instance directory {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 19:38:06 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Creating image(s)
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Did not create local disks {{(pid=72810) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Ensure instance console log exists: /opt/stack/data/nova/instances/8cf9ea90-02ff-4772-836b-aa512c5a2a0e/console.log {{(pid=72810) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Start _get_guest_xml network_info=[{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDxGLsJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cf9ea90-02ff-4772-836b-aa512c5a2a0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b183adb8-6d4a-493a-97fc-04ca35b83515', 'serial': 'b183adb8-6d4a-493a-97fc-04ca35b83515'}, 'attachment_id': '683effdd-2700-496c-b333-84b3d20671b9', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'guest_format': None, 'device_type': 'disk', 'volume_type': None} {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 19:38:06 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:38:06 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller missing on host. {{(pid=72810) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.host [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU controller found on host. {{(pid=72810) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72810) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T18:35:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image limits 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flavor pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Image pref 0:0:0 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Got 1 possible topologies {{(pid=72810) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.hardware [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72810) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Calling os-brick to attach iSCSI Volume {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDxGLsJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:38:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:38:06 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:38:06 user nova-compute[72810]: INFO os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa42e65-2558-4af3-8498-f139d8b88304]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 19:38:06 user nova-compute[72810]:  {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --interface default --op new {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[832993f7-d1d9-4f8e-b59c-8f4004287bf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515] added\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515] added
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e7a7b-13f9-4a50-a77a-47c433d4e971]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be73fe2-30ec-4b68-8a18-08d93613355a]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDxGLsJb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XDxGLsJb" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ba5f57-0f47-4a68-b307-dbcd52cbb4c8]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XDxGLsJb'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fadc6a7-822f-4a95-b4a6-eb681364247d]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a347ed-44e6-4cd1-8d00-17fe625964c3]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --login {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[35de4670-0997-47cc-bdea-900c67a0a805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260]
Jul 31 19:38:06 user nova-compute[72810]: Login to [iface: default, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260] successful.
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b120f2-d3c3-48ba-aa0c-8cc37a64ab3b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[67153674-5edf-4aa1-abce-a4dba5431359]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)
Jul 31 19:38:06 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to 172.16.0.220:3260 {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72810) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72810) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f3529f-4d7c-445d-9145-a50ac19c2149]: (4, ('- - 0', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:38:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72810) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDxGLsJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72810) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23039643336373235', 'path': '/dev/sdc'} {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039643336373235', 'path': '/dev/sdc'} {{(pid=72810) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-311432708',display_name='tempest-TestVolumeBootPattern-server-311432708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-311432708',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-lyoorem3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:37:59Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=8cf9ea90-02ff-4772-836b-aa512c5a2a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72810) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.objects.instance [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cf9ea90-02ff-4772-836b-aa512c5a2a0e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 19:38:07 user nova-compute[72810]:   <uuid>8cf9ea90-02ff-4772-836b-aa512c5a2a0e</uuid>
Jul 31 19:38:07 user nova-compute[72810]:   <name>instance-00000033</name>
Jul 31 19:38:07 user nova-compute[72810]:   <memory>524288</memory>
Jul 31 19:38:07 user nova-compute[72810]:   <vcpu>1</vcpu>
Jul 31 19:38:07 user nova-compute[72810]:   <metadata>
Jul 31 19:38:07 user nova-compute[72810]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 19:38:07 user nova-compute[72810]:       <nova:package version="0.0.0"/>
Jul 31 19:38:07 user nova-compute[72810]:       <nova:name>tempest-TestVolumeBootPattern-server-311432708</nova:name>
Jul 31 19:38:07 user nova-compute[72810]:       <nova:creationTime>2023-07-31 19:38:06</nova:creationTime>
Jul 31 19:38:07 user nova-compute[72810]:       <nova:flavor name="m1.tiny">
Jul 31 19:38:07 user nova-compute[72810]:         <nova:memory>512</nova:memory>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:disk>1</nova:disk>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:swap>0</nova:swap>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:vcpus>1</nova:vcpus>
Jul 31 19:38:07 user nova-compute[72810]:       </nova:flavor>
Jul 31 19:38:07 user nova-compute[72810]:       <nova:owner>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:user uuid="5faf892d5f364c9b83e6f9983c7725cf">tempest-TestVolumeBootPattern-1300522126-project-member</nova:user>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:project uuid="48969fbade07485885e72fc3a2964678">tempest-TestVolumeBootPattern-1300522126</nova:project>
Jul 31 19:38:07 user nova-compute[72810]:       </nova:owner>
Jul 31 19:38:07 user nova-compute[72810]:       <nova:ports>
Jul 31 19:38:07 user nova-compute[72810]:         <nova:port uuid="e75e996f-838d-481d-b145-081fcf5c9aa1">
Jul 31 19:38:07 user nova-compute[72810]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 19:38:07 user nova-compute[72810]:         </nova:port>
Jul 31 19:38:07 user nova-compute[72810]:       </nova:ports>
Jul 31 19:38:07 user nova-compute[72810]:     </nova:instance>
Jul 31 19:38:07 user nova-compute[72810]:   </metadata>
Jul 31 19:38:07 user nova-compute[72810]:   <sysinfo type="smbios">
Jul 31 19:38:07 user nova-compute[72810]:     <system>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="product">OpenStack Nova</entry>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="version">0.0.0</entry>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="serial">8cf9ea90-02ff-4772-836b-aa512c5a2a0e</entry>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="uuid">8cf9ea90-02ff-4772-836b-aa512c5a2a0e</entry>
Jul 31 19:38:07 user nova-compute[72810]:       <entry name="family">Virtual Machine</entry>
Jul 31 19:38:07 user nova-compute[72810]:     </system>
Jul 31 19:38:07 user nova-compute[72810]:   </sysinfo>
Jul 31 19:38:07 user nova-compute[72810]:   <os>
Jul 31 19:38:07 user nova-compute[72810]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 19:38:07 user nova-compute[72810]:     <boot dev="hd"/>
Jul 31 19:38:07 user nova-compute[72810]:     <smbios mode="sysinfo"/>
Jul 31 19:38:07 user nova-compute[72810]:   </os>
Jul 31 19:38:07 user nova-compute[72810]:   <features>
Jul 31 19:38:07 user nova-compute[72810]:     <acpi/>
Jul 31 19:38:07 user nova-compute[72810]:     <apic/>
Jul 31 19:38:07 user nova-compute[72810]:     <vmcoreinfo/>
Jul 31 19:38:07 user nova-compute[72810]:   </features>
Jul 31 19:38:07 user nova-compute[72810]:   <clock offset="utc">
Jul 31 19:38:07 user nova-compute[72810]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 19:38:07 user nova-compute[72810]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 19:38:07 user nova-compute[72810]:     <timer name="hpet" present="no"/>
Jul 31 19:38:07 user nova-compute[72810]:   </clock>
Jul 31 19:38:07 user nova-compute[72810]:   <cpu mode="custom" match="exact">
Jul 31 19:38:07 user nova-compute[72810]:     <model>Nehalem</model>
Jul 31 19:38:07 user nova-compute[72810]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 19:38:07 user nova-compute[72810]:   </cpu>
Jul 31 19:38:07 user nova-compute[72810]:   <devices>
Jul 31 19:38:07 user nova-compute[72810]:     <disk type="block" device="disk">
Jul 31 19:38:07 user nova-compute[72810]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 19:38:07 user nova-compute[72810]:       <source dev="/dev/sdc"/>
Jul 31 19:38:07 user nova-compute[72810]:       <target dev="vda" bus="virtio"/>
Jul 31 19:38:07 user nova-compute[72810]:       <serial>b183adb8-6d4a-493a-97fc-04ca35b83515</serial>
Jul 31 19:38:07 user nova-compute[72810]:     </disk>
Jul 31 19:38:07 user nova-compute[72810]:     <interface type="ethernet">
Jul 31 19:38:07 user nova-compute[72810]:       <mac address="fa:16:3e:5c:13:66"/>
Jul 31 19:38:07 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:38:07 user nova-compute[72810]:       <mtu size="1442"/>
Jul 31 19:38:07 user nova-compute[72810]:       <target dev="tape75e996f-83"/>
Jul 31 19:38:07 user nova-compute[72810]:     </interface>
Jul 31 19:38:07 user nova-compute[72810]:     <serial type="pty">
Jul 31 19:38:07 user nova-compute[72810]:       <log file="/opt/stack/data/nova/instances/8cf9ea90-02ff-4772-836b-aa512c5a2a0e/console.log" append="off"/>
Jul 31 19:38:07 user nova-compute[72810]:     </serial>
Jul 31 19:38:07 user nova-compute[72810]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 19:38:07 user nova-compute[72810]:     <video>
Jul 31 19:38:07 user nova-compute[72810]:       <model type="virtio"/>
Jul 31 19:38:07 user nova-compute[72810]:     </video>
Jul 31 19:38:07 user nova-compute[72810]:     <rng model="virtio">
Jul 31 19:38:07 user nova-compute[72810]:       <backend model="random">/dev/urandom</backend>
Jul 31 19:38:07 user nova-compute[72810]:     </rng>
Jul 31 19:38:07 user nova-compute[72810]:     <controller type="usb" index="0" model="none"/>
Jul 31 19:38:07 user nova-compute[72810]:     <memballoon model="virtio">
Jul 31 19:38:07 user nova-compute[72810]:       <stats period="10"/>
Jul 31 19:38:07 user nova-compute[72810]:     </memballoon>
Jul 31 19:38:07 user nova-compute[72810]:   </devices>
Jul 31 19:38:07 user nova-compute[72810]: </domain>
Jul 31 19:38:07 user nova-compute[72810]:  {{(pid=72810) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-311432708',display_name='tempest-TestVolumeBootPattern-server-311432708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-311432708',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-lyoorem3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T19:37:59Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=8cf9ea90-02ff-4772-836b-aa512c5a2a0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG os_vif [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83') {{(pid=72810) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape75e996f-83, may_exist=True, interface_attrs={}) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape75e996f-83, col_values=(('external_ids', {'iface-id': 'e75e996f-838d-481d-b145-081fcf5c9aa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:13:66', 'vm-uuid': '8cf9ea90-02ff-4772-836b-aa512c5a2a0e'}),), if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:07 user nova-compute[72810]: INFO os_vif [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83')
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72810) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 19:38:07 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] No VIF found with MAC fa:16:3e:5c:13:66, not building metadata {{(pid=72810) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG nova.compute.manager [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] No waiting events found dispatching network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:38:08 user nova-compute[72810]: WARNING nova.compute.manager [req-f5e4b784-fab1-4be0-b5c4-34b3110a71a6 req-b46a9e80-6c56-4aaf-a7ee-1d6e4deaa8ce service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received unexpected event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 for instance with vm_state building and task_state spawning.
Jul 31 19:38:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:08 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832290.8427665, 8cf9ea90-02ff-4772-836b-aa512c5a2a0e => Resumed> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] VM Resumed (Lifecycle Event)
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Instance event wait completed in 0 seconds for  {{(pid=72810) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Guest created on hypervisor {{(pid=72810) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Instance spawned successfully.
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_cdrom_bus of ide {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_disk_bus of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_input_bus of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_pointer_model of None {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_video_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Found default for hw_vif_model of virtio {{(pid=72810) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.virt.driver [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] Emitting event <LifecycleEvent: 1690832290.843921, 8cf9ea90-02ff-4772-836b-aa512c5a2a0e => Started> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] VM Started (Lifecycle Event)
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72810) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.compute.manager [None req-ca398390-6522-4da3-b0d5-9056b4c12c9e None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 19:38:10 user nova-compute[72810]: INFO nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Took 4.91 seconds to spawn the instance on the hypervisor.
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:38:10 user nova-compute[72810]: DEBUG nova.compute.manager [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] No waiting events found dispatching network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:38:10 user nova-compute[72810]: WARNING nova.compute.manager [req-4d2cc341-06f0-485b-af1f-acd92be1e78a req-48d6c830-e359-4c2f-a704-3094b4228218 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received unexpected event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 for instance with vm_state building and task_state spawning.
Jul 31 19:38:11 user nova-compute[72810]: INFO nova.compute.manager [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Took 12.98 seconds to build instance.
Jul 31 19:38:11 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-d7b7b49a-c0fd-4ca0-8bab-9d6c6ad59d71 tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.103s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:38:12 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:38:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:38:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:38:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:38:14 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:19 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:22 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:24 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:29 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:34 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:39 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:38:56 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:38:56 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:38:57 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:39:00 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:39:01 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:39:01 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.174480438232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 93d13ccf-1d94-437e-8480-5d2301488654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 8cf9ea90-02ff-4772-836b-aa512c5a2a0e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:39:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:02 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:07 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:39:12 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:39:13 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:39:13 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:39:13 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:39:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:17 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:22 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:27 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:32 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:37 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:42 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:39:47 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:48 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing instance network info cache due to event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] Acquiring lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] Acquired lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updated VIF entry in instance network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:39:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-f49f92e9-2086-47e5-9a00-79ed99208261 req-cc5ec772-6ee0-4af8-af31-cf3c82c0e6f8 service nova] Releasing lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:51 user nova-compute[72810]: INFO nova.compute.manager [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Terminating instance
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing instance network info cache due to event network-changed-e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] Acquiring lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] Acquired lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Refreshing network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-unplugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] No waiting events found dispatching network-vif-unplugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.compute.manager [req-6fcfb5e6-4dd1-4b9b-8433-75dc31828fd1 req-089a1aac-a7f4-4b94-b5d7-6cb85f65e822 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-unplugged-e75e996f-838d-481d-b145-081fcf5c9aa1 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:39:51 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Instance destroyed successfully.
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.objects.instance [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid 8cf9ea90-02ff-4772-836b-aa512c5a2a0e {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-311432708',display_name='tempest-TestVolumeBootPattern-server-311432708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-311432708',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:38:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-lyoorem3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:38:11Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=8cf9ea90-02ff-4772-836b-aa512c5a2a0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_vif [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape75e996f-83, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:39:51 user nova-compute[72810]: INFO os_vif [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:13:66,bridge_name='br-int',has_traffic_filtering=True,id=e75e996f-838d-481d-b145-081fcf5c9aa1,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape75e996f-83')
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XDxGLsJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:39:51 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updated VIF entry in instance network info cache for port e75e996f-838d-481d-b145-081fcf5c9aa1. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG nova.network.neutron [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [{"id": "e75e996f-838d-481d-b145-081fcf5c9aa1", "address": "fa:16:3e:5c:13:66", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape75e996f-83", "ovs_interfaceid": "e75e996f-838d-481d-b145-081fcf5c9aa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9d4278-f2b6-4a68-9850-7ce5302da832]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-df1ebda7-f240-48fc-9790-a10e74aa3b7e req-5a2aafdb-f0b9-4c5b-826c-8639d9764261 service nova] Releasing lock "refresh_cache-8cf9ea90-02ff-4772-836b-aa512c5a2a0e" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b23f48-07c6-4fe8-8fa7-85c375da27bd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:39:51 user nova-compute[72810]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)
Jul 31 19:39:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:39:51 user nova-compute[72810]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 (non-flash)
Jul 31 19:39:51 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68ec216c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515'): ({'sdc'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdc {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a6647-e41a-49ba-bc09-9a4b5b9623ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[086b4a2d-cf03-4afb-810d-8c0ae3c8d766]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdc {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b234b-1184-4005-a8de-7dc1231f9c76]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:39:51 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251a9c3-9405-4603-80ab-07c5ff425df5]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdc have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374d24d-d837-49e2-a68a-b204e61a104b]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[e847c32a-9dae-4026-b00d-c7cafae37a26]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260]
Jul 31 19:39:52 user nova-compute[72810]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515, portal: 172.16.0.220,3260] successful.
Jul 31 19:39:52 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b183adb8-6d4a-493a-97fc-04ca35b83515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e692d2-491a-4118-8066-aebdbfeda08f]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (274ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:39:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Deleting instance files /opt/stack/data/nova/instances/8cf9ea90-02ff-4772-836b-aa512c5a2a0e_del
Jul 31 19:39:52 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Deletion of /opt/stack/data/nova/instances/8cf9ea90-02ff-4772-836b-aa512c5a2a0e_del complete
Jul 31 19:39:52 user nova-compute[72810]: INFO nova.compute.manager [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 19:39:52 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:39:52 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:39:52 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Took 0.50 seconds to deallocate network for instance.
Jul 31 19:39:53 user nova-compute[72810]: INFO nova.compute.manager [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] Acquiring lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] No waiting events found dispatching network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:39:53 user nova-compute[72810]: WARNING nova.compute.manager [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received unexpected event network-vif-plugged-e75e996f-838d-481d-b145-081fcf5c9aa1 for instance with vm_state deleted and task_state None.
Jul 31 19:39:53 user nova-compute[72810]: DEBUG nova.compute.manager [req-5d68c17e-9b52-468f-b0c1-4f4180ef1437 req-0390f64f-e698-41c6-858a-4d12d2ccb754 service nova] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Received event network-vif-deleted-e75e996f-838d-481d-b145-081fcf5c9aa1 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:53 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance 8cf9ea90-02ff-4772-836b-aa512c5a2a0e
Jul 31 19:39:53 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-08a74d18-051c-43c0-bceb-c6a7a07d345b tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "8cf9ea90-02ff-4772-836b-aa512c5a2a0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:39:54 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:56 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:39:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:39:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:40:01 user nova-compute[72810]: DEBUG nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72810) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 19:40:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:40:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.17354965209961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Instance 93d13ccf-1d94-437e-8480-5d2301488654 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72810) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:40:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:06 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690832391.8008919, 8cf9ea90-02ff-4772-836b-aa512c5a2a0e => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:40:06 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] VM Stopped (Lifecycle Event)
Jul 31 19:40:06 user nova-compute[72810]: DEBUG nova.compute.manager [None req-e3dc8619-f636-425d-ba03-b63225658ea8 None None] [instance: 8cf9ea90-02ff-4772-836b-aa512c5a2a0e] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:40:06 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:07 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:11 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Forcefully refreshing network info cache for instance {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 19:40:14 user nova-compute[72810]: DEBUG nova.objects.instance [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lazy-loading 'info_cache' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:40:15 user nova-compute[72810]: DEBUG nova.network.neutron [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:40:15 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:40:15 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated the network info_cache for instance {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 19:40:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:16 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:21 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:24 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:26 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:31 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:36 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:41 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:40:46 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG nova.compute.manager [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing instance network info cache due to event network-changed-2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] Acquiring lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] Acquired lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG nova.network.neutron [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Refreshing network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:49 user nova-compute[72810]: INFO nova.compute.manager [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Terminating instance
Jul 31 19:40:49 user nova-compute[72810]: DEBUG nova.compute.manager [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Start destroying the instance on the hypervisor. {{(pid=72810) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-unplugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] No waiting events found dispatching network-vif-unplugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [req-348a69de-110c-414e-bded-19c71b1b6473 req-87ebd0b8-e8e8-40c4-901d-f30e30efb473 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-unplugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 for instance with task_state deleting. {{(pid=72810) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updated VIF entry in instance network info cache for port 2f7ac1f2-2440-4a82-a998-bef8a08645b3. {{(pid=72810) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [{"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-9a5d9038-1f68-4516-8a92-0b02eb7e71ea req-fd790510-1453-4939-8674-d34dfbea2349 service nova] Releasing lock "refresh_cache-93d13ccf-1d94-437e-8480-5d2301488654" {{(pid=72810) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 19:40:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Instance destroyed successfully.
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.objects.instance [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lazy-loading 'resources' on Instance uuid 93d13ccf-1d94-437e-8480-5d2301488654 {{(pid=72810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.vif [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T19:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1812938694',display_name='tempest-TestVolumeBootPattern-server-1812938694',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1812938694',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACXdclQtKxXLWZKDflDSOqxZX0kNQeHvVQp5i8lAZhePayGB6JDK9+plzS2wDy5nWCiFNzfE0ms4zJZVvu1V0W1wCyxgnSJsaQnM7JcemP0RLL8FzpejlANkOXok3Wyuw==',key_name='tempest-TestVolumeBootPattern-573485637',keypairs=<?>,launch_index=0,launched_at=2023-07-31T19:36:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48969fbade07485885e72fc3a2964678',ramdisk_id='',reservation_id='r-0080ebvw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1300522126',owner_user_name='tempest-TestVolumeBootPattern-1300522126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T19:36:08Z,user_data=None,user_id='5faf892d5f364c9b83e6f9983c7725cf',uuid=93d13ccf-1d94-437e-8480-5d2301488654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converting VIF {"id": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "address": "fa:16:3e:42:82:89", "network": {"id": "9282197e-dd72-4bfa-8eea-dcf3cbcac5df", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1732890148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48969fbade07485885e72fc3a2964678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f7ac1f2-24", "ovs_interfaceid": "2f7ac1f2-2440-4a82-a998-bef8a08645b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.network.os_vif_util [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24') {{(pid=72810) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_vif [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24') {{(pid=72810) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f7ac1f2-24, bridge=br-int, if_exists=True) {{(pid=72810) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:40:50 user nova-compute[72810]: INFO os_vif [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:89,bridge_name='br-int',has_traffic_filtering=True,id=2f7ac1f2-2440-4a82-a998-bef8a08645b3,network=Network(9282197e-dd72-4bfa-8eea-dcf3cbcac5df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f7ac1f2-24')
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] calling os-brick to detach iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f68ec184160>, {'target_iqns': ['iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XquFsBxI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 19:40:50 user nova-compute[72810]: WARNING os_brick.initiator.connectors.base [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406', 0)] {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d83190-6c27-444b-9588-31b3cb9ffa5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e01220-6dd1-4a5a-a6f7-ae8af6ffd2f1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:40:50 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 (non-flash)
Jul 31 19:40:50 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f68dc499b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406'): ({'sdb'}, set())}) {{(pid=72810) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Removing single pathed devices sdb {{(pid=72810) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d65e5-5932-4a8c-ab30-118690f03379]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9a14a-295b-476d-9297-ab88c8bddd8d]: (4, ('ok\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Flushing IO for device /dev/sdb {{(pid=72810) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c40239-5763-4f1a-9eca-6326baa90f23]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72810) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb37563-7aa4-43b4-99a4-c8743bbc0a7a]: (4, ('1', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.linuxscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] SCSI volumes sdb have been removed. {{(pid=72810) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO629bfe4a-e46f611491fb60c9', '/dev/disk/by-id/scsi-26534366636313134', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_629bfe4a') {{(pid=84119) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c59498c-c97f-4b27-a373-d4746d7bd258]: (4, None) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406')] {{(pid=72810) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb9cac-299b-464a-9ad1-86a05be1d1ef]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --logout {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6c641-26b0-4137-b4fa-1310ad65dcbe]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260]
Jul 31 19:40:50 user nova-compute[72810]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406, portal: 172.16.0.220,3260] successful.
Jul 31 19:40:50 user nova-compute[72810]:  stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op delete {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e7465b-1b82-402b-955c-61152c1ef406 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84119) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf3f06-cfe4-451d-9afe-9bbb2a96e663]: (4, ('', '')) {{(pid=84119) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72810) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.base [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG os_brick.initiator.connectors.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] <== disconnect_volume: return (272ms) None {{(pid=72810) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Disconnected iSCSI Volume {{(pid=72810) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 19:40:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Deleting instance files /opt/stack/data/nova/instances/93d13ccf-1d94-437e-8480-5d2301488654_del
Jul 31 19:40:50 user nova-compute[72810]: INFO nova.virt.libvirt.driver [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Deletion of /opt/stack/data/nova/instances/93d13ccf-1d94-437e-8480-5d2301488654_del complete
Jul 31 19:40:50 user nova-compute[72810]: INFO nova.compute.manager [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Took 1.11 seconds to destroy the instance on the hypervisor.
Jul 31 19:40:50 user nova-compute[72810]: DEBUG oslo.service.loopingcall [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72810) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.compute.manager [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Deallocating network for instance {{(pid=72810) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 19:40:50 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] deallocate_for_instance() {{(pid=72810) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 19:40:51 user nova-compute[72810]: DEBUG nova.network.neutron [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Updating instance_info_cache with network_info: [] {{(pid=72810) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 19:40:51 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Took 0.92 seconds to deallocate network for instance.
Jul 31 19:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] Acquiring lock "93d13ccf-1d94-437e-8480-5d2301488654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] Lock "93d13ccf-1d94-437e-8480-5d2301488654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] No waiting events found dispatching network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 19:40:52 user nova-compute[72810]: WARNING nova.compute.manager [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received unexpected event network-vif-plugged-2f7ac1f2-2440-4a82-a998-bef8a08645b3 for instance with vm_state active and task_state deleting.
Jul 31 19:40:52 user nova-compute[72810]: DEBUG nova.compute.manager [req-53b4188d-a528-492a-9183-cb0eec1c103f req-499d49aa-549d-4389-b93c-49d1d9e273b9 service nova] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Received event network-vif-deleted-2f7ac1f2-2440-4a82-a998-bef8a08645b3 {{(pid=72810) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 19:40:52 user nova-compute[72810]: INFO nova.compute.manager [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Took 0.72 seconds to detach 1 volumes for instance.
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:52 user nova-compute[72810]: INFO nova.scheduler.client.report [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Deleted allocations for instance 93d13ccf-1d94-437e-8480-5d2301488654
Jul 31 19:40:52 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-42f8540a-cb1b-4c37-8587-b6af4042158a tempest-TestVolumeBootPattern-1300522126 tempest-TestVolumeBootPattern-1300522126-project-member] Lock "93d13ccf-1d94-437e-8480-5d2301488654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.087s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:40:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:40:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:40:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:41:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:01 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:41:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:41:01 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:41:01 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:41:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:41:02 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.17266845703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:41:02 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690832450.4771369, 93d13ccf-1d94-437e-8480-5d2301488654 => Stopped> {{(pid=72810) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 19:41:05 user nova-compute[72810]: INFO nova.compute.manager [-] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] VM Stopped (Lifecycle Event)
Jul 31 19:41:05 user nova-compute[72810]: DEBUG nova.compute.manager [None req-323bae62-fe85-4b8c-a37e-a6ec9bc6448f None None] [instance: 93d13ccf-1d94-437e-8480-5d2301488654] Checking state {{(pid=72810) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:06 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:09 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72810) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 19:41:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:13 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:41:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:41:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:41:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:41:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:26 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:41:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:31 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:48 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Cleaning up deleted instances {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 19:41:48 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] There are 0 instances to clean {{(pid=72810) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 19:41:49 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:52 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:41:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:41:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:42:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:03 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:42:03 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:42:03 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Auditing locally available compute resources for user (node: user) {{(pid=72810) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 19:42:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:42:04 user nova-compute[72810]: WARNING nova.virt.libvirt.driver [None req-77024774-b0a3-448b-9426-880e001cea18 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.1710205078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72810) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72810) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing inventories for resource provider 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating ProviderTree inventory for provider 1f952763-889d-4346-89af-cc061f930545 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Updating inventory in ProviderTree for provider 1f952763-889d-4346-89af-cc061f930545 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing aggregate associations for resource provider 1f952763-889d-4346-89af-cc061f930545, aggregates: None {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Refreshing trait associations for resource provider 1f952763-889d-4346-89af-cc061f930545, traits: COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI {{(pid=72810) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.provider_tree [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed in ProviderTree for provider: 1f952763-889d-4346-89af-cc061f930545 {{(pid=72810) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.scheduler.client.report [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Inventory has not changed for provider 1f952763-889d-4346-89af-cc061f930545 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72810) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG nova.compute.resource_tracker [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Compute_service record updated for user:user {{(pid=72810) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 19:42:04 user nova-compute[72810]: DEBUG oslo_concurrency.lockutils [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72810) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 19:42:05 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:08 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:09 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:10 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:14 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Starting heal instance info cache {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 19:42:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Rebuilding the list of instances to heal {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 19:42:14 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Didn't find any instances for network info cache update. {{(pid=72810) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 19:42:15 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:15 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:16 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:17 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:19 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:20 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:25 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:27 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:30 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:35 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:40 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72810) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72810) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 19:42:45 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 19:42:50 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:55 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 19:42:57 user nova-compute[72810]: DEBUG oslo_service.periodic_task [None req-77024774-b0a3-448b-9426-880e001cea18 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72810) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 19:42:57 user nova-compute[72810]: DEBUG nova.compute.manager [None req-77024774-b0a3-448b-9426-880e001cea18 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72810) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 19:43:00 user nova-compute[72810]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72810) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}